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ABSTRACT 


In  recent  years,  time  synchronization  has  emerged  as  an  essential  research  topic  for 
wireless  sensor  networks.  Numerous  wireless  network  applications  require  a  common 
reference  time  for  collaborative  data  fusion  and  communications.  Other  time 
synchronization  protocols  have  been  proposed  over  the  years,  but  none  have  eliminated 
the  possibility  of  collisions  associated  with  wireless  packet  transmissions  while 
maintaining  a  precise  level  of  synchronization  for  any  given  topology. 

In  this  thesis,  we  present  a  new  hybrid  time  synchronization  scheme  that  provides 
a  high  degree  of  network-wide  synchronization  and  eliminates  the  possibility  of 
collisions  when  transmitting  timestamp  messages.  We  propose  an  algorithm  that  allows  a 
network  to  determine  a  broadcast  sequence  by  which  nodes  transmit  and  forward 
messages  and  then  conducts  a  network-wide  synchronization  based  on  received 
timestamp  information.  The  proposed  hybrid  time  synchronization  scheme  utilizes  two 
existing  protocols,  namely  relative  referenceless  receiver/receiver  synchronization  and 
ratio-based  synchronization  protocol,  that  provide  a  high  degree  of  precision.  We 
implement  our  broadcast  sequencing  algorithm  in  simulations  and  demonstrate  its 
effective  performance  for  a  series  of  network  topologies.  We  also  present  results 
demonstrating  an  improvement  in  network-wide  synchronization  using  our  hybrid 
scheme  over  other  time  synchronization  protocols. 
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EXECUTIVE  SUMMARY 


Over  the  past  few  deeades,  advances  in  technology  have  resulted  in  smaller  and  more 
efficient  devices  that  enable  communication  among  users.  The  need  for  these  devices  to 
be  wireless  has  attracted  significant  interest  in  commercial  and  government  applications. 
One  of  the  popular  wireless  devices  in  demand  is  a  sensor  node  that  is  capable  of  sensing, 
communicating,  and  processing  data.  Recent  advances  in  the  development  of  low-cost, 
low-power,  multifunctional  sensor  nodes  have  led  to  the  development  of  wireless  sensor 
networks  that  cooperatively  collect  and  disseminate  sensor  data.  Wireless  sensor 
networks  consist  of  a  large  number  of  randomly  deployed  or  self-organized  sensor  nodes 
that  are  appropriate  for  environments  and  operations  that  do  not  have  a  pre-defined 
network  infrastructure,  such  as  disaster  relief  or  search  and  rescue  operations.  The 
attractive  features  of  wireless  sensor  networks  have  extended  research  in  a  wide  range  of 
applications  to  include  medical,  environmental,  and  military  operations. 

One  of  the  most  critical  components  in  the  operation  of  wireless  sensor  networks 
is  clock  synchronization,  as  it  provides  a  common  time  frame  to  different  nodes.  Most  of 
the  applications  for  wireless  sensor  networks  require  monitoring  of  events,  thus  requiring 
sensor  nodes  to  maintain  a  common  reference  time  for  collaborative  data  fusion  and 
communications.  Signal-processing  techniques  that  turn  raw  data  into  meaningful  results 
require  relative  synchronization  among  sensor  node  clocks  in  order  to  detect  a  correct 
chronology  of  events.  As  the  demand  for  wireless  sensor  networks  in  government  and 
commercial  industry  increases,  the  broad  application  of  time  synchronization  will 
become  more  prevalent  as  the  requirement  for  data  exchange  increases. 

The  aim  of  this  thesis  is  to  develop,  model,  and  simulate  a  new  hybrid  time 
synchronization  scheme  that  provides  a  high  degree  of  network-wide  synchronization  and 
eliminates  the  possibility  of  collisions  when  transmitting  timestamp  messages.  Other  time 
synchronization  protocols  offer  accurate  parameter  estimators  that  synchronize  nodes  to 
an  acceptable  range  but  do  not  address  the  challenges  associated  with  some  network 
topologies.  We  present  an  algorithm  that  allows  a  network  to  determine  a  broadcast 

sequence  by  which  nodes  transmit  and  forward  messages,  eliminating  collisions,  and  then 

xvii 


conducts  a  network-wide  synchronization  based  on  received  timestamp  information. 
Sensor  nodes  synchronize  via  one  of  two  previously  proposed  time  synchronization 
protocols,  namely  relative  referenceless  receiver/receiver  synehronization  and  ratio-based 
synchronization  protocol,  that  boast  the  highest  level  of  precision  in  current  researeh; 
thus,  we  present  a  hybrid  seheme. 

Signifieant  improvements  in  network  time  synehronization  were  aehieved  in  this 
thesis  by  our  new  hybrid  scheme.  Simulation  models  using  MATLAB  were  developed  to 
validate  estimators  proposed  in  previous  research  and  to  evaluate  the  performance  of  our 
broadcast  sequencing  algorithm  as  well  as  our  new  hybrid  time  synchronization  scheme. 
Results  in  this  thesis  demonstrate  that  our  algorithm  produees  a  final  broadeast  sequence 
that  includes  a  high  pereentage  of  nodes  and  that  the  sequenee  can  be  utilized  to 
synehronize  a  network  of  any  topology  more  precisely  than  other  known  time 
synchronization  protocols. 

We  made  three  eontributions  in  this  thesis.  We  introduced  a  novel  concept  of 
broadcast  sequencing  that  determines  a  sequence  order  and  eliminates  the  possibility  of 
eollisions.  We  introdueed  new  methods  of  determining  a  reference  node  to  synehronize  to 
and  performing  multi-hop  synchronization  using  an  analysis  of  time  stamp  information. 
Finally,  we  introduced  a  new  hybrid  time  synehronization  seheme  and  validated  its 
superior  performance  over  other  time  synchronization  protocols. 
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I.  INTRODUCTION 


Over  the  past  few  decades,  advances  in  technology  have  resulted  in  smaller  and 
more  efficient  devices  that  enable  communication  among  users.  The  need  for  these 
devices  to  be  wireless  has  attracted  significant  interest  in  commercial  and  government 
applications.  One  of  the  popular  wireless  devices  in  demand  is  a  sensor  node  that  is 
capable  of  sensing,  communicating,  and  processing  data.  Recent  advances  in  the 
development  of  low-cost,  low-power,  multifunctional  sensor  nodes  have  led  to  the 
development  of  wireless  sensor  networks  (WSN)  that  cooperatively  collect  and 
disseminate  sensor  data  [1].  WSNs  consist  of  a  large  number  of  randomly  deployed  or 
self-organized  sensor  nodes  that  are  appropriate  for  environments  and  operations  that  do 
not  have  a  pre-defined  network  infrastructure,  such  as  disaster  relief  or  search  and  rescue 
operations  [2].  The  attractive  features  of  WSNs  have  extended  research  in  a  wide  range 
of  applications  to  include  medical,  environmental,  and  military  operations  [1],  [2]. 

One  of  the  most  critical  components  in  the  operation  of  WSNs,  or  any  networked 
system,  is  clock  synchronization,  as  this  provides  a  common  time  frame  to  different 
nodes  [3].  Most  of  the  applications  for  WSNs  involve  monitoring  of  events,  requiring 
sensor  nodes  to  maintain  a  common  reference  time  for  collaborative  data  fusion  and 
communications  [4].  Signal-processing  techniques  that  turn  raw  data  into  meaningful 
results  require  relative  synchronization  among  sensor  node  clocks  in  order  to  detect  a 
correct  chronology  of  events  [4].  Another  example  is  the  commonly  used  medium  access 
control  (MAC)  protocol,  time-division  multiple  access  (TDMA),  which  requires  precise 
time  synchronization  for  its  scheduling  algorithm  [4],  [5]. 

As  the  demand  for  WSNs  in  government  and  commercial  industry  increases,  the 
broad  application  of  time  synchronization  will  become  more  prevalent  as  the  requirement 
for  data  exchange  increases.  We  present  a  new  time  synchronization  scheme  that  has  the 
potential  to  increase  the  precision  of  a  WSN’s  time  synchronization,  enhancing  the 
network’s  ability  to  facilitate  applications  that  require  synchronization  and  improving  the 
network’s  performance. 
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A,  RELATED  WORK 

Network  time  synchronization  research  began  with  the  global  positioning  system 
(GPS)  and  the  network  time  protocol  (NTP)  [6],  [7].  Both  GPS  and  NTP  work  well  for 
traditional  networks  with  few  power  restraints  but  do  not  scale  well  to  WSNs  as  wireless 
sensor  nodes  do  not  have  a  large  power  capacity.  Typically,  most  deployments  of 
wireless  sensor  nodes  lack  a  real-time  clock  (RTC)  or  access  to  accurate  time,  thus,  time 
synchronization  poses  a  challenge  for  WSNs. 

Ganeriwal  et  al.  [4]  presented  timing-sync  protocol  for  sensor  networks  (TPSN),  a 
time  synchronization  protocol  for  WSNs  based  on  a  two-way  message  exchange  between 
a  sender  and  a  receiver,  similar  to  NTP.  A  limitation  that  TPSN  suffers  from  is  the 
nondeterministic  delay  from  the  sender  and  the  inability  to  account  for  relative  skew 
corrections. 

Maroti  et  al.  [8]  presented  the  flooding  time  synchronization  protocol  (FTSP),  a 
time  synchronization  protocol  for  WSNs  based  on  one-way  broadcasting  from  a  sender  to 
multiple  receivers.  FTSP  also  suffers  from  the  nondeterministic  delay  from  the  sender. 
Sheu  et  al.  [9]  presented  ratio-based  time  synchronization  protocol  (RSP),  which  is  based 
on  FTSP  but  eliminates  some  delay  time,  resulting  in  improved  accuracy.  We  incorporate 
RSP  into  our  proposed  scheme  due  to  this  improvement. 

Elson  et  al.  [10]  presented  reference  broadcast  synchronization  (RBS),  a  receiver- 
to-receiver-based  time  synchronization  protocol  for  WSNs  that  uses  the  exchange  of  the 
arrival  times  of  a  reference  node’s  broadcast  to  synchronize  two  or  more  receivers, 
eliminating  the  nondeterministic  delay  from  the  sender.  A  challenge  that  RBS  suffers 
from  is  that  the  dedicated  reference  node  serves  as  a  single  point  of  failure;  therefore,  it  is 
not  appropriate  for  self-organized  WSNs. 

Djenouri  [11]  presented  relative  referenceless  receiver/receiver  time 
synchronization  (R4Syn),  a  method  based  on  RBS  that  distributes  the  reference  function 
and  uses  proposed  estimators  to  synchronize  a  network  of  nodes.  Djenouri’s  method 
offers  a  high  degree  of  synchronization  accuracy  but  does  not  discuss  how  the  order  of 
the  reference  function  (i.e.,  a  broadcast  sequence)  is  determined  for  multi-hop  topologies. 
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In  this  thesis,  we  ineorporate  R4Syn  into  our  proposed  seheme  and  investigate  the 
ehallenges  assoeiated  with  WSNs,  sueh  as  wireless  paeket  eollisions  and  ehanges  in 
topology,  both  of  whieh  affeet  a  network’s  ability  to  synehronize. 

B,  OBJECTIVE  AND  APPROACH 

The  objeetive  of  this  thesis  is  to  develop  and  demonstrate  a  new  time 
synehronization  seheme  that  addresses  the  ehallenges  of  any  type  of  wireless  ad  hoe 
network  topology  and  improves  the  overall  preeision  of  the  network’s  time 
synehronization. 

We  propose  a  new  time  synehronization  seheme  based  on  a  broadeast  sequenee 
that  determines  the  order  by  whieh  nodes  transmit  timing  information  in  an  effort  to 
eliminate  eollisions.  With  this  broadeast  sequence,  nodes  transmit  messages  and 
synchronize  as  a  network  using  one  of  two  different  time  synchronization  protocols.  We 
conduct  MATLAB  simulations  to  evaluate  the  performance  of  the  broadcast  sequencing 
algorithm  and  the  new  hybrid  time  synchronization  scheme. 

C.  THESIS  ORGANIZATION 

Sources  of  clock  synchronization  error  and  an  overview  of  fundamental  time 
synchronization  approaches  are  presented  in  Chapter  II.  Our  proposal  of  a  hybrid  time 
synchronization  scheme  using  the  broadcast  sequencing  algorithm  and  two  previously 
published  protocols  is  presented  in  Chapter  III.  Results  of  simulation  experiments  that 
validate  and  evaluate  the  hybrid  time  synchronization  scheme  are  presented  in  Chapter  IV. 
The  findings  of  this  thesis  and  recommendations  for  future  work  on  time  synchronization 
for  WSNs  are  discussed  in  Chapter  V.  Additional  flow  charts  for  determining  broadcast 
sequences  are  included  in  Appendix  A.  Source  codes  for  calculations  and  simulations  are 
included  in  Appendix  B. 
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II.  BACKGROUND 


In  Chapter  I,  we  mentioned  the  need  for  and  importanee  of  small,  low-cost 
wireless  sensors  for  many  applications.  In  order  for  a  network  of  wireless  sensor  nodes  to 
effectively  conduct  operations,  their  clocks  need  to  be  synchronized  as  precisely  as 
possible.  Time  synchronization  provides  a  common  notion  of  time  across  a  distributed 
system  for  fundamental  operations,  such  as  data  fusion,  power  management,  transmission 
scheduling  and  localization  protocols  [3]. 

In  the  following  sections,  we  discuss  the  different  sources  of  error  in  time 
synchronization,  such  as  clock  drift  and  delay  times,  in  wireless  packet  transmissions.  We 
provide  a  brief  overview  of  the  fundamental  time  synchronization  approaches  currently  in 
literature  and  discuss  some  of  the  protocols  related  to  each  approach.  We  conclude  the 
chapter  with  an  in-depth  discussion  of  one  of  the  more  recently  proposed  time 
synchronization  protocols,  relative  referenceless  receiver/receiver  synchronization 
(R4Syn),  which  we  adopt  in  our  proposed  hybrid  scheme. 

A,  SOURCES  OF  ERROR  IN  TIME  SYNCHRONIZATION 

We  begin  by  describing  the  clock  of  a  sensor  node  X  as  C^(t)  where  t  is  real 
time.  For  a  crystal-quartz  oscillator  commonly  used  in  sensor  nodes,  the  frequency  can 
vary  up  to  40  parts  per  million  (ppm)  [3].  These  differences  in  frequencies  cause  clocks 
to  gradually  drift  from  each  other  over  time.  Additionally,  if  clocks  are  not  perfectly 
tuned  to  the  same  start  time  initially,  there  is  a  clock  offset  O ,  which  is  the  phase 
difference  of  two  clocks.  The  clock  relationship  between  Node  X  to  another  Node  Y  is 
represented  by 

Q(0  =  /x,yXQ(0  +  O;,_j.,  (1) 

where  y  and  y  are  the  relative  clock  skew  (frequency  difference)  and  clock  offset 
(phase  difference)  between  Node  X  and  Node  Y,  respectively  [3].  If  the  two  nodes  were 
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perfectly  synchronized,  then  y  would  equal  1  and  y  would  equal  0.  The  goal  of 
clock  synchronization  is  to  estimate  y  and  y  as  accurately  as  possible  so  that  Node 
X  can  adjust  its  clock  to  Node  Y  [3]. 


In  a  perfect  world  where  there  is  no  delay  in  message  delivery,  nodes  can  send 
their  current  time  to  other  nodes  for  synchronization  with  absolute  precision. 
Unfortunately,  we  face  various  delays  that  affect  message  delivery  in  wireless  sensor 
networks  and  make  clock  synchronization  a  difficult  task.  These  delays  in  message 
delivery  include  the  following  [3],  [8]; 

•  Send  time:  Nondeterministic  time  used  to  build  the  message  at  the 
application  layer  on  the  sender’s  side.  This  includes  delays  caused  by  the 
operating  system  when  processing  the  request. 

•  Access  time:  Nondeterministic  time  for  the  sender  to  access  the  transmit 
channel  after  reaching  the  medium  access  control  (MAC)  layer. 
Depending  on  the  MAC  protocol,  this  is  the  least  deterministic 
component. 

•  Transmission  time:  Nondeterministic  time  for  the  sender  to  transmit  the 
message  at  the  physical  layer. 

•  Propagation  time:  Deterministic  time  that  a  message  takes  to  go  from  the 
sender  to  the  receiver.  This  only  depends  on  the  distance  between  two 
nodes. 

•  Reception  time:  Nondeterministic  time  for  the  receiver  to  receive  the 
message  at  the  physical  layer.  This  is  the  same  as  transmission  time. 

•  Receive  time:  Nondeterministic  time  for  the  receiver  to  process  the 
message  and  send  to  the  application  layer.  This  is  similar  to  the  send  time. 

In  addition  to  these  various  delay  times  in  packet  transmissions,  clocks  are  also 
affected  by  environmental  conditions  such  as  temperature  and  atmospheric  pressure. 
Aging  hardware  and  voltage  changes  can  affect  clock  parameters  as  well  [3]. 

B,  EXISTING  TIME  SYNCHRONIZATION  PROTOCOLS 

In  this  section,  we  discuss  fundamental  approaches  to  clock  synchronization  in 
WSNs  using  timing  messages  to  account  for  the  various  delays  discussed  in  the  previous 
section.  We  explore  three  different  approaches  and  discuss  some  of  the  protocols  that 
exist  in  current  literature. 
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1. 


Two-way  Message  Exchange 


In  this  conventional  approach,  a  sender  and  reeeiver  synchronize  by  exchanging 
timing  messages  with  each  other  [3].  We  illustrate  this  approaeh  using  Figure  1  where 
parent  Node  Y  wants  to  synchronize  with  child  Node  X.  For  one  round  of  message 
exchange,  Node  Y  sends  a  synchronization  message  to  Node  X  at  .  Node  X  records  its 
local  time  that  it  received  Node  F’s  message  at  and  sends  a  reply  message  to  Node  Y  at 
.  Node  Y  reeeives  the  reply  message  that  eontains  the  timestamps  ^nd  at  its  local 
time  ^4 .  Using  the  four  timestamps.  Node  Y  can  calculate  its  relative  offset  to  Node  X. 

After  k  rounds  of  message  exchanges.  Node  Y  obtains  a  series  of  timestamps  that  passes 
through  filters  and  statistieal  analysis  to  obtain  an  aceurate  estimator.  This  classie 
approach  is  the  foundation  of  the  NTP,  which  has  kept  the  internet’s  clock  ticking  with 
accurate  synchronization;  however,  NTP  was  designed  for  traditional  computer  networks 
and  is  not  suitable  for  WSNs  [3],  [7]. 


X  receives 
request  at  t  ^ 

Parent  Node 

0 - ^ 


Y  requests  time 
synch  with  X 


Child  Node 


X  sends 
message  at  1 3 

U 

- - - ' - ^ - > 

Message  contains 
1 2  and  r  3 


- - - ^ 

^  4  Continue  exchange  k  times, 

Y  receives  P®**  through  filters  and 

message  at  t,  statistical  analysis 


Figure  1.  Two-way  message  exehange  for  time  synehronization  of  two  nodes  (after 

[3]). 


Another  popular  protocol  that  adopted  the  two-way  message  exchange  approach 
for  wireless  sensor  networks  is  timing-synehronization  protoeol  for  sensor  networks 
(TPSN).  TPSN  works  in  two  phases  (a  level  discovery  phase  and  a  synehronization 

phase)  to  provide  network-wide  time  synchronization  based  off  of  the  two-way  message 
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exchange  approach  [4].  In  the  level  discovery  phase,  a  hierarchical  network  structure  is 
created,  and  then  a  pair  wise  synchronization  is  performed  along  the  edges  of  the 
structure  [4],  This  establishes  a  global  timescale  throughout  the  network  to  which  all 
nodes  eventually  synchronize  their  clocks  during  the  synchronization  phase  [4], 
Hardware  experiments  using  Berkeley  motes  resulted  in  an  average  accuracy  of  less  than 
20  //5  for  a  pair  of  neighboring  nodes  [4],  Some  of  our  concerns,  however,  include  the 
lack  of  relative  skew  corrections  and  the  lack  of  broadcasting  capability.  Larger  networks 
could  potentially  lead  to  higher  costs. 

2,  One-way  Dissemination 

In  this  approach,  a  parent  or  reference  node  simply  broadcasts  its  timing 
information  to  its  children  nodes.  The  receiving  nodes  record  and  collect  the  arrival  times 
of  the  broadcast  message  as  shown  in  Figure  2  and  then  compute  relative  parameters 
using  least-squares  estimation  [3].  The  flooding  time  synchronization  protocol  (FTSP) 
adopts  this  approach,  where  a  single,  dynamically  elected  parent  node  maintains  the 
network  time  while  other  nodes  synchronize  their  clocks  to  the  parent  node  [8].  Hardware 
experiments  on  Berkeley  motes  resulted  in  an  average  precision  of  1.5  //5  in  a  single-hop 
scenario  and  0.5  /us  per  hop  in  a  multi-hop  scenario  [8]. 


Parent  Node  X  sends  messages  at  t  ^  ^  ,  t  ^  ^  ,  t  ^  ^  ,  . . . ,  t  ^  ^ 


Child(ren)  y  receives  messages  at  fy  , ,  j  >  L'  3  >  •  •  •’ 
Node(s) 


Figure  2.  One-way  dissemination  (i.e.,  broadcasting)  for  time  synchronization  of 
multiple  children  nodes  by  one  parent  node  (after  [3]). 
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A  more  recently  proposed  broadcasting  protocol,  ratio-based  time  synchronization 
protocol  (RSP),  is  similar  to  FTSP,  but  uses  only  two  synchronization  messages  to 
synchronize  receivers  to  the  sender  as  shown  in  Figure  3  [9].  In  RSP,  the  authors  propose 
using  a  ratio  of  the  timestamps  to  calculate  the  relative  skew  and  offset,  respectively,  of 
Node  Y  to  Node  X,  given  by  [9] 


and 


t  —t 

£4  £2 


(2) 

(3) 


The  RSP  method  eliminates  some  delay  time  compared  to  FTSP,  resulting  in  slightly 
improved  accuracy  during  hardware  experimentation  [9].  Because  of  its  improved 
accuracy  and  simple  implementation,  we  incorporate  the  concept  of  RSP  into  our 
proposed  hybrid  time  synchronization  scheme  in  Chapter  III. 


T  1  X  sends  messages  at 
Parent  Node 


^4 

Child(ren)  y  receives  messages  at 
Node(s)  ^2  and 

Figure  3.  RSP  message  broadcasting  (after  [9]).  A  parent  node  synchronizes  children 

nodes  using  two  timing  messages. 

3,  Receiver-receiver  Synchronization 

In  this  approach,  a  dedicated  parent  or  reference  node  sends  beacons  while  the 
receiving  children  nodes  record  the  arrival  times  and  exchange  their  arrival  timestamps 
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with  one  another  to  caleulate  their  relative  skew  and  offset  to  the  parent  node  [3].  The 
exchange  of  arrival  timestamps  is  illustrated  in  Figure  4. 

This  approach,  also  called  reference  broadcast  synchronization  (RBS),  uses  the 
broadcast  nature  to  reduce  the  time-critical  path  (i.e.,  the  sender’s  nondeterministic  delay) 
that  results  in  high  uncertainty  and  low  accuracy  [10].  Flardware  experiments  using 
Berkeley  motes  resulted  in  a  clock  precision  of  1.85  +  1.28//.^  for  a  pair  of  receivers  and 
degraded  as  the  number  of  hops  increased  in  a  multi -hop  environment  [10].  When  RBS 
was  compared  to  TPSN  under  the  same  scenario  in  [4],  TPSN  performed  almost  twice  as 
well  as  RBS  in  regards  to  average  synchronization  error. 


Parent  Node 
X  broadcasts  message 

© 

Children 

Nodes 

0  © 

Y  receives  broadcast  at  t  j  Z  receives  broadcast  at  t  ^ 

Y  and  Z  exchange  arrival  timestamps  with  each  other 

Figure  4.  RBS  synchronization  (after  [3]). 

One  of  the  major  drawbacks  of  RBS  is  the  dedicated  reference  node  [11].  It  serves  as 
a  single  point  of  failure  if  it  were  to  be  eliminated,  which  is  not  appropriate  for  self- 
organized  WSNs  [11].  Additionally,  RBS  requires  separate  transmissions  for  exchanging 
timestamps,  which  increases  the  communications  overhead  [11].  More  recently,  however, 
a  new  protocol  to  address  these  concerns  is  proposed  in  [11],  which  we  discuss  in  the 
next  section. 
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c. 


RELATIVE  REFERENCELESS  RECEIVER/RECEIVER  TIME 
SYNCHRONIZATION 


We  now  formally  introduce  relative  referenceless  receiver/receiver  time 
synchronization  (R4Syn),  a  receiver-receiver-based  protocol  that  attempts  to  address 
some  of  the  drawbacks  of  RBS  and  serves  as  the  primary  method  for  the  hybrid  time 
synchronization  scheme  proposed  in  this  thesis. 

1,  Methodology  Overview 

This  protocol  assumes  that  the  network  is  static  (mobility  is  not  considered)  and 
that  nodes  are  located  in  the  same  vicinity  of  each  other  and  are  aware  of  their  neighbor 
IDs.  Unlike  RBS,  R4Syn  distributes  the  reference  function  amongst  all  nodes,  running  in 
cycles  where  nodes  sequentially  broadcast  beacons  [11].  For  a  neighborhood  of  N  nodes, 
each  beacon  piggybacks  N-\  previously  received  timestamps.  One  cycle  of  beacon 
broadcasting  is  illustrated  in  Figure  5,  where  B.  j  denotes  the  j"’  beacon  of  node  i,  and 

denotes  the  reception  timestamp  at  node  k  of  the  /'*  beacon  of  node  i  [11].  For 
example,  beacon  .  would  piggyback  timestamps  [1  !]•  These  timestamps  are 

then  used  as  samples  to  estimate  relative  skew  and  offset.  More  specifically, 
synchronization  between  Nodes  1  and  2  (i.e..  Node  2’s  estimation  of  synchronization 
parameters  with  respect  to  Node  1)  occur  by  gathering  timestamp  sample  pairs 

and  [11]. 

After  a  sufficient  number  of  beacons,  each  node  obtains  the  same  number  of 
timestamps  that  can  be  arranged  into  a  matrix  of  reception  timestamps. 


for  one  cycle  of  broadcasting,  where  the  asterisk  “  *  “  denotes  the  broadcasting  node.  By 
observation,  the  location  of  a  timestamp  in  the  matrix  T  is  the  k-th  row  and  the  i-th 
column. 
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Figure  5.  Example  of  R4Syn  beacon  broadcast  during  one  cycle  (after  [11]). 


If  andvj^,  k  ,  is  denoted  as  the  k'’'  beacon  reception  timestamp  of 

Nodes  1  and  2,  respectively,  then  only  beacons  received  by  both  nodes  are  used  to 
construct  timestamp  samples,  Using  maximum-likelihood  (ML)  estimation,  we 

obtain  the  resultant  estimates  for  relative  skew  and  offset  using  7  broadcast  messages  (i.e., 
timestamp  values)  as  [1 1] 


(ml  = 


II  I 
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For  multi-hop  environments,  nodes  perform  multi-hop  synchronization  only  on 


demand,  where  intermediate  nodes  forward  local  synchronization  parameters  to  the 
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communicating  nodes  to  allow  them  to  ealeulate  multi -hop  parameters  [11].  Consider  that 
Node  1  needs  to  synehronize  to  a  remote  node  q  where  the  established  route  is 
{1,2,3,..., q) .  Eaeh  intermediate  Node  h  is  assumed  to  already  have  estimated  parameters 
relating  it  to  the  next  Node  h  +  \  using  the  one -hop  parameters  in  Equations  (5)  and  (6) 
and  forwards  its  estimates  to  Node  1 .  If  we  let  (respectively  )  denote  the 

relative  skew  (respeetively  offset)  of  Node  j  to  Node  k,  then  the  multi-hop  estimators  for 
the  example  are  given  as  [11] 

(7) 

>=1 

and 

q-\ 

=  X 

j=2 

2.  Advantages 

Simulation  results  that  compare  the  mean-squared  error  of  the  proposed 
estimators  and  the  eorresponding  Cramer-Rao  lower  bounds  (CRLB)  are  presented  in 
[11].  Results  show  that  the  proposed  estimators’  mean-squared  error  deerease  and 
approach  the  CRLB  as  the  number  of  broadeast  messages  inereases. 

The  mean-squared  error  for  the  multi-hop  skew  estimator  was  also  simulated  in  a 
multi -hop  linear  network  of  10  nodes  in  [11].  Simulation  results  demonstrated  that  an 
inerease  of  the  number  of  messages  improves  the  preeision  even  with  a  higher  number  of 
hop  values.  Eurthermore,  results  show  that  the  mean-squared  error  is  kept  at  an 
aeeeptable  range  for  a  small  number  of  messages  as  well  as  a  large  number  of  hops. 

In  addition  to  the  performanee  of  R4Syn’s  estimators,  there  are  other  advantages 
that  the  protoeol  offers  over  RBS.  Beeause  R4Syn  distributes  the  referenee  function 
among  all  nodes,  there  is  no  single  point  of  failure  as  is  the  ease  with  RBS.  R4Syn  also 
allows  timestamps  to  be  piggybacked  to  beaeons  so  that  the  need  for  separate 
transmissions  for  exehanging  timestamps  is  eliminated.  It  exploits  the  broadcast  property 
of  RBS,  whieh  takes  advantage  of  the  preeision  aehieved  through  receiver-reeeiver 
synehronization. 


f  j  ) 

Ylfk^ki 

\k=2  J 

+  0 


2->l  ' 


(8) 
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3. 


Drawbacks  and  Issues 


Despite  the  attractive  benefits  that  R4Syn  offers,  there  are  some  potential  flaws 
with  the  proposed  protocol  that  are  not  addressed.  We  present  these  drawbacks  using  the 
topology  in  Figure  6,  where  nodes  are  depicted  by  yellow  circles  labeled  numerically  and 
the  solid  black  lines  indicate  that  a  pair  of  nodes  can  communicate.  Our  main  concern  is 
related  to  the  sequence  by  which  the  nodes  broadcast  their  beacons  for  a  self-organized 
network.  In  [11],  node  IDs  are  used  to  determine  the  order  of  the  sequence  and  the 
beacons  are  broadcast  sequentially,  but  how  the  order  of  the  sequence  is  determined  is 
not  proposed.  Consider  a  topology  as  in  Figure  6  and  assume  that  the  order  of  the 
sequence  is  a  simple  ascending  order  of  node  IDs.  If  Node  1  starts  the  beacon  process, 
then  Node  3  never  knows  to  broadcast  because  it  never  receives  a  beacon  from  Node  2. 
Even  if  Node  3  knew  to  broadcast  upon  receiving  a  message  from  Node  I,  there  is  a 
possibility  of  a  collision  at  Node  4  from  Node  2’s  and  Node  3’s  broadcasts.  If  we 
continue  the  sequence  order  to  Node  10  (last  node),  there  is  no  way  for  Node  1  to  know 
when  to  broadcast  again  and  begin  the  next  cycle.  Another  issue  that  R4Syn  fails  to 
address  is  how  the  entire  network  gets  synchronized  (i.e.,  to  which  node  all  other  nodes 
synchronize). 


Figure  6.  An  example  topology  to  illustrate  drawbacks  to  R4Syn. 

In  this  chapter,  we  first  discussed  the  different  sources  of  error  in  time 
synchronization,  such  as  clock  drift  and  delay  times  in  wireless  packet  transmissions.  We 
then  provided  a  brief  overview  of  the  fundamental  time  synchronization  approaches  and 
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protocols  currently  in  literature,  one  of  wtiieli  (RSP)  we  incorporate  into  our  proposed 
hybrid  protoeol.  Finally,  we  introdueed  R4Syn  and  diseussed  the  advantages  as  well  as 
the  drawbacks  that  are  not  addressed  in  the  literature.  In  the  next  chapter,  we  propose 
potential  solutions  to  those  drawbacks  by  presenting  a  new  hybrid  time  synchronization 
scheme  that  signilieantly  incorporates  R4Syn’s  eoncepts. 
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III.  NETWORK  TIME  SYNCHRONIZATION  IN  MULTI-HOP 
WSN  USING  R4SYN-RSP  HYBRID  PROTOCOL 


The  crux  of  this  thesis  effort  is  the  proposal  of  an  innovative  approach  for  an  ad- 
hoc  wireless  sensor  network  to  synchronize  the  nodes’  clocks  as  precisely  as  possible. 
This  new  approach  is  rooted  in  the  network’s  ability  to  determine  a  sequential  order,  or 
broadcast  sequence,  by  which  nodes  transmit  upon  receiving  a  message  from  a  neighbor 
node.  This  broadcast  sequence  allows  the  maximum  number  of  nodes  to  transmit 
timestamp  information  sequentially  in  order  to  eliminate  the  possibility  of  collisions  and 
to  maximize  the  number  of  timestamp  samples  received  by  each  node.  As  discussed  in 
Chapter  II,  as  a  node  acquires  more  timestamp  samples,  it  is  be  able  to  generate  more 
accurate  parameter  estimation  for  relative  skew  and  offset.  Using  the  broadcast  sequence, 
we  introduce  a  new  method  of  collecting  and  analyzing  timestamp  information  to 
determine  how  nodes  are  synchronized  and,  if  required,  synchronize  any  neighbor  nodes. 
We  formally  introduce  this  new  time  synchronization  scheme  in  this  chapter. 

A.  PROPOSED  TIME  SYNCHRONIZATION  SCHEME 

We  must  begin  the  framework  with  a  random  deployment  of  unsynchronized 
sensor  nodes  that  form  an  ad-hoc  wireless  sensor  network.  It  is  assumed  that  every  node 
has  the  ability  to  communicate  with  at  least  one  other  node  and  discovery  of  one-hop 
neighbors  is  complete  [2].  Our  network-wide  synchronization  scheme  consists  of  three 
major  steps:  determining  a  broadcast  sequence,  conducting  a  sequence  correction  check, 
and  synchronizing  via  one  of  two  existing  protocols,  namely  R4Syn  and  RSP  (see 
Chapter  II). 

We  begin  with  a  node  we  call  the  starter  node  that  is  arbitrarily  selected  to 
initiate  the  broadcast  sequence  discovery  and  flood  the  network  to  begin  the  broadcast 
sequencing  process.  When  the  starter  node  y^j^  receives  sequence  information  back  from 

its  one-hop  neighbors,  it  determines  the  most  node-inclusive  broadcast  sequence  for 

the  network  and  broadcasts  the  sequence  to  proceed  with  the  scheme.  Upon  receiving  , 

each  subsequent  node  in  the  sequence  performs  a  sequence  correction  check  if  required 
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and  proceeds  with  its  broadcast  according  to  its  location  incJ^^ .  The  broadeast  messages 
include  all  previous  reeeption  timestamps;  thus,  information  forwarding  is  a  key  element 
to  this  proposed  seheme.  By  simply  examining  the  timestamp  information,  eaeh  node 
determines  the  master  reference  node  ,  the  node  to  whieh  the  entire  network  attempts 
to  synehronize.  The  network  then  conducts  a  hybrid  time  synchronization  technique  using 
R4Syn  and  RSP  parameter  estimation.  This  proposed  scheme  is  summarized  in  Figure  7. 


Figure  7.  Proposed  time  synchronization  scheme. 


B.  BROADCAST  SEQUENCING 

We  now  propose  a  solution  to  the  sequeneing  and  collision  problems  of  R4Syn 
presented  in  Chapter  II.  In  this  section,  we  deseribe  the  intuitive  eoneept  behind 
discovering  the  most  node-inclusive  broadcast  sequence  5j^g  ,  diseuss  the  flooding 

procedure  that  the  starter  node  initiates,  deseribe  how  sequenees  are  determined  by 

eaeh  node,  and  provide  flow  diagrams  to  illustrate  the  logic  behind  sequence 
determination. 


18 


1,  Broadcast  Sequencing  Concept 

As  we  introduced  in  the  previous  section,  an  arbitrarily  chosen  starter  nodey^^ 
initiates  the  protocol  and  floods  the  network  after  the  nodes  have  been  deployed.  After 
the  starter  node  receives  pertinent  information  back  from  its  one-hop  neighbors,  it 

attempts  to  determine  a  broadcast  sequence  that  includes  the  maximum  number  of  nodes 
in  the  network.  To  illustrate  this  idea,  we  examine  a  topology  in  Figure  8.  If  Node  1  is 
selected  to  be  the  starter  node  y^j^ ,  then  Node  1  determines  a  broadcast  sequence  5^g  like 

{1,  2,  4,  3,  5}.  Specifically,  this  means  that  Node  2  transmits  after  receiving  Node  I’s 
broadcast.  Node  4  transmits  after  receiving  Node  2’s  broadcast.  Node  3  transmits  after 
receiving  Node  4’s  broadcast,  and  so  on.  If  Node  4  was  selected  to  be  ,  it  still 
determines  a  like  {5,  3,  4,  1,  2}  but  not  a  sequence  like  {4,  3,  5,  2,  1}.  In  the  latter 

case,  not  only  does  the  sequence  have  an  error  since  Nodes  2  and  5  are  not  neighbors,  but 
also  Node  2  never  transmits  because  it  never  receives  a  broadcast  from  Node  5. 

The  main  idea  behind  determining  5^^^  is  that  whichever  node  is  the  starter  node, 
5^^  should  include  the  maximum  number  of  nodes  in  an  order  that  nodes  know  when  it  is 
their  turn  to  broadcast  upon  receiving  a  broadcast  message  from  one  of  its  neighbors. 
This  eliminates  any  possibility  of  collisions  because  each  node  in  has  its  own  turn  to 

broadcast.  When  it  is  the  broadcast  turn  of  nodes  in  the  beginning  or  end  of  ,  those 
beginning/end  nodes  reverse  the  sequence  to  continue  the  broadcast  cycle.  More 
specifically,  using  the  example  of  Node  1  as  y^j^  with  a  of  {1,  2,  4,  3,  5},  Node  5 
reverses  the  sequence  to  {5,  3,  4,  2,  1}  and  forwards  that  sequence  during  its  turn  so  that 
Node  3  knows  to  broadcast  next  upon  receiving  the  message  from  Node  5. 
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Figure  8.  Example  topology  illustrating  the  intuitive  concept  behind  determining  a 

broadcast  sequence  that  will  eliminate  collisions. 


2,  Flooding 

The  protocol  begins  with  the  starter  node  flooding  the  network  with  an 

initialization  message.  In  this  flooding  phase,  nodes  simply  exchange  hop  count 
information  with  their  one-hop  neighbors  as  the  initialization  message  propagates 
throughout  the  network.  We  denote  the  minimum  number  of  hops  from  y^^  to  a  given 

node  X  as  .  Clearly, 

(9) 

After  a  Node  X  receives  from  all  of  its  neighbors,  it  determines  its  own  as 

H_(Z)  =  min(H.„„(r^,.  ,,„„(X)))  +  1 ,  (10) 

where  ^ Neighborsi^)  defined  as  Node  X’s  list  of  neighbors.  Unlike  a  sequence  like 

where  the  order  matters,  the  order  of  nodes  in  a  list  does  not  matter.  Given  the  minimum 
hop  count  information,  nodes  define  one-hop  neighbor  relationships  according  to  .  If 

=  k  hops,  then  the  list  of  the  parents  of  X,  rp(X)  ,  is  defined  as  one -hop 
neighbor  nodes  with  =k-\  hops.  The  list  of  the  children  of  X,  r^(X) ,  is  defined  as 
one-hop  neighbor  nodes  with  a  =  k  -l-l  hops.  The  list  of  the  friends  of  X,  r^(X)  ,  is 
defined  as  one-hop  neighbor  nodes  with  the  same  value  of  as  Node  X.  The  one-hop 
neighbor  relationships  are  summarized  in  Table  1. 
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Table  1 .  Summary  of  one-hop  neighbor  relationships. 


Minimum  Number  of  Hops  from  (H^^) 

Relationship  to  Node  X 

k-  1 

Parents  of  X 

k 

Friends  of  X 

k+\ 

Children  of  X 

Using  the  topology  example  in  Figure  9  where  Node  1  is  ,  we  see  that  Node  4 
defines  its  lists  of  one-hop  neighbors  as  rp(4)  =  [1],  r^(4)  =[2],  rp(4)  =  [3,5] . 


3 

Figure  9.  Topology  illustrating  minimum  hop  counts  from  the  starter  node,  =  1 . 

These  hop  counts  are  used  to  define  a  node’s  relationships  to  its  neighbors. 

3,  Network’s  Broadcast  Sequence 

According  to  the  parent-friend-child  relationships  defined  in  the  previous  section, 
we  see  that  nodes  without  children  determine  their  sequences  first.  For  a  childless  node  L, 
its  sequence  is  simply  defined  as 

^(L)<-{L}.  (11) 

Next,  the  childless  nodes  broadcast  their  sequences  to  their  parents,  which  also 

implies  that  all  of  the  neighbors  of  the  childless  nodes  receive  the  sequence  information 

as  well.  Along  with  the  sequences,  those  nodes  send  two  additional  items:  their  list  of 

21 


friends  r^(L)  and  their  total  number  of  parents  A^p(L)  .  When  a  parent  node  receives 
sequence  information  from  all  of  its  children,  it  determines  its  own  sequence  and  sends  it 
to  its  parents,  and  so  on.  Parent  nodes  also  send  their  list  of  children  in  addition  to 
their  list  of  friends  and  the  total  number  of  parents.  These  items  are  used  when  a  parent 
node  has  multiple  children  nodes  with  equal  sequence/list  lengths  and  needs  to  determine 
which  child  node’s  sequence  is  the  most  node-inclusive.  Detailed  flow  charts  that 
describe  how  F^.  ,  F^  and  Np  are  used  in  sequence  determination  are  included  in 

Appendix  A.  This  phase  of  the  protocol  is  complete  when  the  starter  node;)^^^  receives 
sequences  from  all  of  its  children  and  determines  for  the  network. 

Next,  we  describe  how  each  node’s  sequence  is  determined  in  detail  using  the 
example  topology  of  Figure  9,  where  Node  1  is  the  starter  node  .  From  Equation  (11), 
we  can  see  that  S(2)  <—  {2}  ,  (^(S)  <—  {3} ,  and  <^(6)  <—  {6}  since  those  nodes  do  not  have 
any  children  nodes.  Those  three  nodes  broadcast  their  sequences,  list  of  friends,  and 
number  of  parents  immediately  after  determining  their  own  sequence.  Per  the  relationship 
definitions  from  the  previous  section,  we  see  that  Node  1  is  a  parent  to  Nodes  2  and  4, 
Node  4  is  a  parent  to  Nodes  3  and  5,  and  Node  5  is  a  parent  to  Node  6. 

Beginning  with  Node  5,  we  see  that  it  has  only  one  child  node.  Node  6.  Node  6’s 
sequence  includes  only  its  own  ID,  thus.  Node  5  determines  that 

A(5)^{A(6),5}.  (12) 

Since  <^(6)  =  {6} ,  Node  5’s  sequence  becomes 

^(5)  =  {6,5}.  (13) 

Node  5  then  broadcasts  <^(5),  F^(5),  Fp(5),  and  Np(5)  to  its  neighbors  because  it  has 
received  sequences  from  all  of  its  children. 

After  Node  4  receives  this  broadcast  from  Node  5,  it  can  determine  its  own 
sequence.  Because  Node  4  has  two  children  nodes.  Nodes  3  and  5,  we  begin  by  defining 

r«c(4)=rc(4)  (14) 
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where  RC  is  a  short  notation  for  remaining  children  so  that  r^p(4)  =  [3,5] .  Node  4  then 
finds  Node  5  to  have  the  longer  sequenee  of  the  two  ehildren  nodes,  so  it  takes  on  Node 
5’s  sequence  as  its  own:  <5(4)  <— {<5(5)} ,  or  <5(4)  =  {6,5}  .  Node  4’s  list  of  remaining 

children  r^p(4)  is  updated  by  removing  Node  5  from  the  list,  so  r^p(4)  =  [3] .  We  define 
the  last  node  of  a  sequence  as 

ri..=^(X)_,^=l,2,...,m  (15) 

where  i  is  the  index  of  the  sequence  of  any  node  X,  and  m  is  the  number  of  nodes  in  the 
sequence.  So,  in  the  case  of  Node  4,  =  5 .  Next,  Node  4  updates  its  sequence  by 

examining  and  r^(3) .  Because  y^^,  is  a  member  node  of  Node  3’s  list  of  friends 
rp(3) ,  Node  4  updates  its  sequence  as  follows: 

<5(4)  ^{<5(4),  3}.  (16) 

Because  Node  3  was  added  to  <5(4) ,  Node  3  is  removed  from  r^p(4)  and 
becomes  an  empty  list;  that  is,  the  number  of  its  remaining  children  is  zero.  Node  4 
completes  its  sequence  by  appending  itself  at  the  end,  <5(4)  <— {<5(4),4}  and, 
subsequently,  broadcasts  <5(4),  r^(4),  r^(4),  and  Np(4)  so  that  its  parent  node.  Node 
1  (also  the  starter  node  y^j^ ),  can  determine  <5^^  for  the  whole  network.  Because  of  this 
network’s  topology.  Node  1  follows  the  same  algorithmic  steps  as  Node  4  to  determine 
that^^^  =  {6, 5, 3, 4, 2,1}  ,  which  includes  every  node  in  the  network.  This  makes  it  an  all¬ 
node-inclusive  sequence  because  every  node  has  a  turn  to  broadcast,  generating  more 
timestamp  samples  to  use  the  R4Syn  estimators  and  synchronize  with  more  precision. 
The  final  sequences  for  each  node  can  be  seen  in  Figure  10. 
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^(5)  =  {6,5} 


Figure  10.  Example  of  each  node’s  final  sequences  according  to  broadcast  sequencing. 

The  starter  node  =  1  determined  a  sequence  that  included  all  nodes  in  the 

network. 

Node  1  now  commences  the  network  time  synchronization  by  first  reversing 
to  {1,2, 4, 3, 5, 6}  and  then  broadcasting  as  a  message.  The  receiving  nodes  (Node  2 
and  4)  record  the  reception  timestamps  of  Node  1  ’s  broadcast  message.  Node  2  knows  to 
broadcast  next  because  it  is  after  Node  1  in  and  Node  2  received  the  broadcast  from 
Node  1.  On  the  other  hand.  Node  4  knows  to  wait  to  broadcast  until  it  receives  a 
broadcast  from  Node  2,  eliminating  any  possibility  of  a  collision.  As  nodes  receive 
subsequent  broadcasts,  they  know  when  it  is  their  respective  turns  to  transmit  depending 
on  their  location  in  .  Nodes  use  the  reception  timestamp  information  to  conduct 
network  time  synchronization,  which  we  discuss  in  the  later  sections  with  more  detail. 

4,  Broadcast  Sequencing  Flow  Charts 

The  sequence  determination  scheme  described  in  the  preceding  sections  can  be 
represented  by  flow  charts  displayed  in  Figures  1 1  and  12  as  well  as  those  in  Figures  39- 
45  in  Appendix  A.  These  flow  charts  provide  the  logical  process  behind  the  sequence 
determination  algorithm  at  each  node.  In  this  section,  we  also  introduce  and  explain 
additional  variables  that  were  not  transparent  in  the  previous  sections. 

When  a  node  has  only  one  child  node,  it  checks  to  see  where  that  child’s  ID  is 
with  respect  to  its  own  sequence  per  Figure  11.  For  example,  if  Node  2  has  a  child  Node 
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3  with  a  sequence  of  <5(3)  =  {6, 5, 1,3, 2, 4} ,  it  sees  that  Node  3’s  ID  is  in  the  fourth  index 
of  this  sequence.  The  sequence,  5^^  (short  for  longer  side),  is  {6, 5, 1,3}  because  it  contains 
more  nodes  in  that  sequence  than  the  right  half  of  the  sequence  ({3,2,4}).  To  complete 
Node  2’s  sequence  according  to  Figure  1 1,  we  get  S(2)  =  (6, 5, 1,3, 2} . 


Figure  1 1 .  Flow  chart  illustrating  sequence  determination  for  nodes  with  less  than  two 

children  nodes. 


When  a  node  has  more  than  one  child  node,  there  are  more  algorithmic  steps  to 
determine  its  sequence.  We  now  clarify  the  additional  variables  and  functions  found  in 
the  flow  charts  displayed  in  Figure  12  and  Figures  39-45  in  Appendix  A. 

We  begin  by  using  a  generic  node,  say  Node  5,  with  three  children  nodes;  1,  3, 
and  8,  so  F^,.  (5)  -[1,3,8] .  We  denote  the  child  node  with  the  longest  sequence  as  Node 
A.  In  order  to  determine  its  sequence.  Node  5  first  chooses  the  child  node  A,  say  Node  1, 
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so  A  =  1 .  Say  Node  I’s  sequence  is  {7, 6, 4, 1,2}  ,  so  Node  5  updates  its  sequence  with 
Node  I’s  sequence  (i.e.,  <7(5)  =  {7,6,4,1,2}). 

Continuing  with  the  flow  chart  in  Figure  12,  we  denote  5,^^  as  Node  A’s  sequence 
up  to  and  including  its  ID.  For  example,  in  Node  I’s  case,  =  {7,6,4,!} .  The  sequence 
^inci  is  potentially  used  in  Node  5’s  sequence  determination  depending  on  the  sequence  of 
the  child  node  D  with  the  next  longest  sequence.  The  same  concept  applies  to  Sj^^2  ’ 
which  we  denote  as  Node  D’s  sequence  up  to  and  including  its  ID. 

Next,  Node  5  updates  its  list  of  remaining  children  by  removing  Node  1  from 
r^^(5)  since  Node  1  was  added  onto  Node  5’s  sequence,  so  now  r^p(5)  =  [3,8] .  Recall 
the  last  node  from  the  previous  section  except  in  this  case,  =  2  since 
S(5)  =  {7, 6, 4, 1,2} .  Say  Node  3  is  a  parent  (or  friend)  of  Node  2,  so  Node  3  is  added  onto 
Node  5’s  sequence  (i.e.,  <5(5)  =  {7, 6, 4,1, 2,3}  ).  This  add  parent/friend  function  is  detailed 
further  in  Appendix  A,  where  we  assign  the  variable  PF  a  logical  1  (i.e.,  PF  =  1)  if  a 
node  is  added  to  the  sequence  during  the  function  and  a  logical  0  otherwise  (i.e.,  PF  =  0). 
Node  5’s  list  of  remaining  children  is  consequently  updated  to  r^^(5)  =  [8]  since  Node  3 
was  added  onto  Node  5’s  sequence. 

Continuing  with  the  flow  chart  in  Figure  12,  Node  5  checks  to  see  if  its  list  of 
remaining  children  r^^(5)  is  empty,  which  it  is  not.  So  Node  5  chooses  Node  8  as  D,  the 

child  node  with  the  next  longest  sequence  (which,  in  this  case.  Node  8  is  the  only  child 
node  left  and  has  the  next  longest  sequence  by  default).  Say  Node  8’s  sequence  is 
(7(8)  =  {11,9,8,10}.  Node  5  then  sets  the  next  sequence as  Node  8’s  sequence  (i.e., 

^Next  -  {1 1’  9, 8, 10}  ),  and  Sj^^2  -  0 1’  9, 8}  according  to  the  same  logic  as  .  Next,  Node  5 
updates  its  list  of  remaining  children  by  removing  Node  8,  making  F^^ (5)  empty.  Per 
Figure  12,  the  value  PFNext=  0.  Node  5  then  updates  its  sequence  S(5)  and  according 
to  the  PF  and  PF^ext  values,  which  is  outlined  in  Appendix  A.  For  this  example, 
(7(5)  =  {7, 6, 4, 1, 2, 3}  since  PF=\,  and  =  {1 1, 9, 8}  since  PF^ext  =  0. 
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Next,  Node  5  eheeks  for  similarities  between  its  sequenee  and  whieh  it  does 
not  have.  So  Node  5  updates  its  sequenee  (5'(5)  <— {(5'(5),5,reverse((5'^^^,)}  per  Figure  12, 
where  reverse((5'^^^J  is  simply  reversing  (i.e.,  {8,9,11}).  Node  5’s  sequenee  thus 
beeomes<5'(5)  =  {7,6,4,1,2,3,5,8,9,11}  .  Sinee  Node  5’s  list  of  remaining  ehildren  is  empty, 
it  eompletes  its  sequenee  determination. 

If  there  are  similarities  between  <7(5)  and  then  Node  5  adjusts  its  sequenee 

per  the  flow  eharts  detailed  in  Figures  43-45  loeated  in  Appendix  A.  The  input  1  in 
Figure  12  is  a  reeursive  step  from  some  of  the  funetions  in  Appendix  A. 


6PQ^[SPQ,X} 


Add  Parent/F riend 
Update  Use  (A) 


Yes  6PQ  <-  { SPQ  ,  X,  reverse(<5v„,) } 


Are  there 
similarities 
betneen  SPQ 
■^and 


Is  Trc  W 

emptj? 


Ylasf  YlaS  ^Sext 

Update  seX) 

Add  Parent/Friend  (Next) 

and  .Sycrt 
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C.  SEQUENCE  CORRECTION 


In  actuality,  the  sequence  eorreetion  cheek  ean  be  eondueted  simultaneously  with 
the  network  time  synchronization  as  the  initial  broadeast  sequenee  5^^  is  forwarded 

aeross  the  network  because  only  reeeption  timestamps  of  the  broadeast  messages  are 
required  for  this.  For  our  purposes,  we  diseuss  the  sequenee  eorreetion  check  as  an 
independent  step  to  prevent  any  eonfusion. 

The  purpose  of  the  sequenee  correction  is  to  add  nodes  into  that  were 
potentially  left  out.  As  is  forwarded  within  the  network,  eaeh  node  performs  an 

additional  sequence  eorreetion  eheek  before  its  broadeast.  We  illustrate  the  need  for  a 
sequence  correction  check  with  the  topology  in  Figure  13.  When  Node  4  is  the  starter 
nodey^jy,  it  generates  =  {6, 3, 2,4,5} ,  whieh  is  not  all  inclusive  beeause  Node  1  is 
missing  from  the  sequenee.  When  Node  5  is  the  starter  node  ,  it  also  generates  a 
that  is  not  all  inclusive.  The  proposed  algorithm  without  a  sequenee  eorreetion  measure 
produees  a  final  S^^g  that  is  not  all  inelusive  a  third  of  the  time  for  this  topology.  In  order 
to  alleviate  this  drawbaek,  we  propose  an  additional  step  for  eaeh  node  as  the  pre- 
sequenee-eorreeted  S^^g  is  forwarded  across  the  network. 


J(4)  =  16,3,2,4,5}  ^(5)  =  {6,3,5} 


Figure  13.  Topology  illustrating  the  need  for  a  sequence  eorreetion  step.  Node  4  does 
not  determine  a  broadeast  sequence  that  ineludes  all  nodes  in  the  network. 
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In  this  example  topology,  Nodes  6  and  5  are  at  the  beginning  and  end  of  5^^^ , 
respeetively,  and  the  neighbors  of  both  nodes  are  ineluded  in  .  If  one  of  those  nodes 
had  a  neighbor  that  was  not  ineluded  in  5j^j^ ,  they  append  that  neighbor  to  the  beginning 
or  end  of  ;  however,  Node  1  is  the  node  that  is  not  in  d^g ,  so  we  denote  Node  1  as  a 
lone  neighbor,  .  In  this  ease.  Node  2  adds  a  field  to  its  broadeast  message  indieating 
that  =  1 ,  whieh  is  forwarded  throughout  the  network.  Eaeh  node  does  a  sequenee 
eorreetion  eheek  and  either  performs  an  aetion  or  ignores  the  field.  For  this  example. 
Node  5  knows  that  Node  3  is  a  neighbor  node,  so  it  adjusts  Sj^/g  to  {2, 4, 5, 3, 6}  .  Now  that 
Node  2  is  at  the  beginning  of  Sj^g ,  it  ean  append  Node  1  to  the  beginning  of  the  sequenee 
so  that^^^  =  {1,2, 4, 5, 3, 6} ,  whieh  ineludes  all  nodes  in  the  network. 

A  detailed  flow  ehart  of  the  sequenee  eorreetion  eheek  for  every  node  is  shown  in 
Figure  14.  Using  Figure  13  with  Node  4  as  the  starter  node,  we  examine  Node  2’s 
sequenee  eorreetion  per  the  flow  ehart  in  Figure  14.  Say  the  order  is  from  left  to  right  in 
Snb  =  {6,3,2, 4,5} ,  so  Node  3  is  Node  2’s  previous  node.  Node  3  does  not  send  a  lone 
neighbor  beeause  all  of  its  neighbors  are  in  Sj^g ;  thus.  Node  3  does  not  have  a  to 
send.  Continuing  on  with  the  flow  ehart,  we  see  that  Node  2  eheeks  to  see  if  it  is  at  the 
beginning  or  end  of  Sj^^g ,  whieh  it  is  not.  Next,  Node  2  finds  a  lone  neighbor  Node  1 

(y^  =1)  and  forwards  that  and  Sj^g  to  the  next  node  in  the  sequenee.  Node  4.  Node  4 
does  the  same  and  forwards  y^  =  1  and  sinee  Node  1  is  not  a  neighbor  and  its  ID  is 
not  at  the  beginning  or  end  of  S^^g .  When  Node  5  reeeives  y^^  =  1  and  from  Node  4, 
it  sees  that  its  ID  is  at  the  end  of  the  sequenee  and  adjusts  to  {2, 4, 5, 3, 6}  beeause 
Node  3  is  one  of  its  neighbors.  Forwarding  of  y^  =  1  and  S^g  eontinues  until  it  reaehes 
Node  2,  whieh  is  now  at  the  beginning  of  Sj^/g .  Node  2  knows  that  its  neighbor.  Node  1,  is 
not  in  Si^/g  and  appends  Node  1  to  the  beginning  of  S^g  per  the  flow  ehart.  Nodes 
eontinue  to  forward  and  use  Sj^^g  in  order  to  distinguish  whieh  node  transmits  when, 
eliminating  any  possibility  of  eollisions  as  previously  diseussed  in  this  ehapter. 
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Figure  14.  Flow  chart  illustrating  the  sequence  correction  check.  Each  node  conducts 
this  check  when  it  receives  from  the  previous  node  in  the  sequence. 


D,  PROPOSED  HYBRID  TIME  SYNCHRONIZATION  PROTOCOL 

In  Chapter  II,  we  discussed  the  merits  of  the  receiver-to-receiver  paradigm 
introduced  by  RBS  and  the  mean-squared  error  of  R4Syn’s  relative  skew  and  offset 
estimators.  We  also  discussed  the  increased  performance  of  RSP  over  FTSP  for 
synchronizing  one -hop  neighbors  via  broadcast  messages.  Based  on  these  concepts,  in 
this  section,  we  propose  a  new  R4Syn-RSP  hybrid  protocol  using  generated  by  the 
network. 

We  first  provide  the  motivation  for  creating  a  hybrid  protocol  vice  solely  relying 
on  RSP  or  R4Syn.  By  broadcasting  timestamp  messages  according  to  S^g  and  generating 
a  matrix  of  timestamps  T  for  each  node,  we  propose  a  novel  method  that  re-defines  T  to 
determine  the  master  reference  node  to  which  all  other  nodes  attempt  to  synchronize. 
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Next,  we  use  the  timestamps  in  T  to  form  matrices  of  the  relative  parameters  of  each  node 
so  that  every  node  has  the  ability  to  reference  another  node’s  relative  parameters  for 
multi-hop  R4Syn  synchronization.  Finally,  we  present  a  flow  chart  that  describes  how 
each  node  determines  the  method  of  synchronization,  and  if  necessary,  broadcasts 
additional  timing  messages  to  synchronize  other  neighboring  nodes. 

1.  Motivation  for  a  Hybrid  Protocol 

Although  the  proposed  broadcast  sequencing  scheme  may  address  the  sequence 
and  collision  avoidance  problems  related  to  R4Syn,  there  still  exist  topologies  where 
R4Syn  falls  short.  We  provide  motivation  for  incorporating  RSP  and  forming  a  hybrid 
protocol  using  the  topology  in  Figure  15. 

If  we  attempt  to  apply  broadcast  sequencing  and  only  R4Syn  to  the  topology  in 
Figure  15,  the  need  for  an  additional  protocol  becomes  obvious.  According  to  the 
proposed  broadcast  sequencing  algorithm,  the  network  generates  a  of 

{4,5,3,2,7,9,10,11}  .  We  assume  that  a  sufficient  number  of  timestamps  have  been 
received  by  each  node  and  are  ready  to  synchronize.  For  illustrative  purposes,  say  Node  7 
is  determined  to  be  the  master  reference  nodey^^  because  it  has  the  most  number  of 
neighbors.  While  Nodes  1,3,  and  10  have  timestamp  pairs  with  Node  7  to  synchronize 
their  clocks  via  1-hop  R4Syn,  the  other  nodes  are  left  without  any  timestamp  pairs  with 
Node  7.  For  this  very  reason,  we  require  another  protocol  to  assist  this  time 
synchronization  scheme. 

We  propose  using  RSP  for  nodes  that  cannot  be  synchronized  directly  via  R4Syn 
due  to  RSP’s  level  of  precision  of  less  than  half  of  a  microsecond.  Given  the  same 
topology  example  in  Figure  15,  Node  7  broadcasts  two  additional  messages  to  its  one-hop 
neighbors  since  none  of  them  can  synchronize  via  R4Syn.  For  nodes  that  can  synchronize 
via  R4Syn,  they  adjust  their  clocks  first  and  then  synchronize  any  unsynchronized 
neighbors  via  RSP.  For  the  same  example.  Node  10  synchronizes  its  clock  to  Node  7’s 
clock  using  the  R4Syn  parameters  and  then  synchronize  Node  1 1  via  RSP  by  sending  two 
timestamp  messages  to  Node  1 1 . 
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Figure  15.  Topology  illustrating  the  need  for  a  hybrid  protoeol  based  on  broadeast 

sequeneing.  Some  sparse  networks  like  this  cannot  conduct  accurate  network¬ 
wide  synchronization  using  only  one  protocol. 

2,  Determination  of  the  Master  Reference  Node 

When  it  is  a  node’s  turn  to  broadcast,  it  forwards  all  previously  received 
timestamp  information  to  its  neighbors.  Receiving  nodes  simply  ignore  duplicate 
information  or  update  their  tables  as  information  is  received.  After  a  sufficient  number  of 
cycles,  each  node  determines  the  master  reference  node  by  analyzing  their  timestamp 
information  to  find  the  node  that  has  the  most  number  of  timestamp  pairs  with  other 
nodes. 

We  consider  one  cycle  as  a  round-trip  sequence  of  nodes  (i.e.,  nodes  transmit 
messages  per  the  order  in  cJ^^and  reversed).  For  example,  for  the  topology  in 

Figure  15  was  {4,  5,  3,  2,  7,  9,  10,  11},  so  a  one-cycle  sequence  is  {4,  5,  3,  2,  7,  9,  10,  11, 
10,  9,  7,  2,  3,  5}.  To  illustrate  this  idea,  we  consider  the  network  topology  in  Figure  8  and 
re-label  the  nodes  as  in  Figure  16. 
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Figure  16.  Topology  illustrating  the  re-defintion  of  T.  Each  node  eventually  forms  the 
same  matrix  of  timestamps.  T  is  used  to  determine  the  master  reference  node 
and  calculate  relative  clock  parameters. 


The  network  determines  to  be  {1, 5, 3, 2, 4}  ,  which  means  that  all  five  nodes 
broadcast  during  this  sequence.  We  extend  the  number  of  broadcasts  M  according  to  our 
definition  of  one  cycle  so  that  the  final  sequence  for  one  cycle  is  {1, 5, 3, 2, 4, 2, 3, 5}  , 
which  means  that  there  is  a  total  of  M  =  8  broadcasts  in  one  cycle  for  this  particular  case. 
In  general,  for  a  network  of  N  nodes  and  a  of  w  nodes, 


M  = 


|2w-2,  iV>4 
I  4,  iV  =  3 


(17) 


where  w  is  the  number  of  nodes  in  Sjyg ,  or  the  length  of  Sjyg .  If  N  =  2,  we  recommend 
that  the  pair  synchronize  using  RSP  or  TPSN.  Our  research  primarily  focuses  on 
networks  of  three  or  more  nodes. 


Using  the  topology  in  Figure  16  and  the  resulting  timestamps  from  one  cycle,  we 
transform  .  of  Equation  (4)  and  re-define  T  as 


T  = 


''1,2 


'3,2 


^3 

1.3 
.3 

2.3 

* 


5,1 


.3 

4.3 
,3 

5.3 


* 

^3,4 

^4,4 


‘■2,5 

<5 

* 


Hi 

^3,6 

4 


.3 

1.7 
3 

2.7 

* 


-  -  -  t 


‘■1,8 


4.7 
3 

5.7 


(18) 


where  ^  refers  to  the  reception  timestamp  at  node  R  from  the  broadcast  of  the  cycle 


sent  by  node  S.  By  observation,  the  subscript  R,M  also  denotes  a  timestamp’s  location  in 
the  matrix  row,  column).  An  asterisk  “  *  “  denotes  the  broadcasting  node,  and  a 
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hyphen  “  -  “  denotes  that  no  timestamps  were  reeeived  from  the  broadcast;  they  are 
only  used  in  this  example  to  assist  the  reader  of  easily  identifying  the  broadcasting  node 
per  . 

Given  the  reception  timestamp  matrix,  each  node  can  determine  .  In  the 

example,  it  is  clear  that  Node  3  (row  3)  has  the  largest  number  of  reception  timestamps 
and  can  form  the  most  number  of  timestamp  pairs  with  other  nodes  and,  thus,  becomes 
.  If  there  were  more  than  one  node  that  could  be  due  to  equal  number  of 
reception  timestamps,  the  node  with  the  smallest  ID  is  chosen  to  be  /mr  ■  So  if  there  was  a 
tie  between  Nodes  2  and  3,  for  example.  Node  2  is  declared  as  Ymr  • 


3,  Relative  Skew  and  Offset 

After  every  cycle,  nodes  use  their  reception  timestamp  matrix  T  to  calculate  their 
relative  skew  and  offset  to  /mr  the  estimators  in  [11],  Given  the  timestamp  matrix 

from  Equation  (18)  where  Node  3  is  /mr’  Node  1  can  use  timestamp  pairs  and 

(tj^8,t3g).  Node  2  can  use  timestamp  pair  ^  Node  4  can  use  timestamp  pairs 

(^44,^34)  and  ,  and  Node  5  can  use  timestamp  pair  (^51,^31)  .  With  these 

timestamp  pairs,  nodes  form  a  A^xA  matrix  of  relative  clock  skews  and  a  Ax  A 
matrix  of  relative  clock  offsets  using  Equations  (5)  and  (6)  as 
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(19) 


(20) 


34 


where  the  elements  ^  andO^  are  denoted  as  Node  ^’s  relative  skew/offset  to  Node 
Given  the  example  topology  in  Figure  16,  Node  1  ean  adjust  its  elock  and  synchronize  to 
Node  3  by  using  Equation  (1)  such  that  C^(t)  =  +  .  All  other  nodes 

synchronize  to  Node  3  via  the  same  method  using  /jj  andO^ . 


Equations  (19)  and  (20)  are  also  needed  for  multi -hop  synchronization.  To 
illustrate  a  topology  requiring  multi-hop  R4Syn  synchronization,  we  use  the  example  in 
Eigure  17,  where  the  resulting  timestamp  matrix  for  one  cycle  is 
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With  Node  3  as  Node  6  can  synchronize  to  Node  3  using  timestamp  pairs 

and  ;  although,  it  is  two  hops  away  from  Node  3.  While  Node  6  is  two  link-hops 

away  from  Node  3,  it  is  only  one  R4Syn-hop  from  Node  3  because  it  has  timestamp  pairs 
with  .  In  the  case  of  Node  7,  it  does  not  have  any  timestamp  pairs  with  y^^  but 
instead  with  Node  2.  Because  Node  2  has  timestamp  pairs  with  y^^ ,  Node  7  is  two 


R4Syn-hops  from  y^^  .  Consequently,  Node  7  uses  the  multi-hop  R4Syn  parameter 

estimators  presented  in  Chapter  II  (see  Equations  (7)  and  (8))  to  adjust  its  clock  to  Node 
3’s.  Thus,  Node  7  synchronizes  to  Node  3  by 

Q  (0  =  fi,3  X  Cj  (t)  +  O7  3  ^22) 

where 


f  7,3  fl,2  X 

9 

^7,3  “  f2,3  X  07,2  ^2,3 

9 

and  the  relative  parameters  f.j 2,  f23^^i 2^'^^^22  are  extracted  from  /j^andO^j. 


(23) 

(24) 
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Figure  17.  Topology  illustrating  multi -hop  R4Syn  synchronization.  Nodes  use  T  to 
determine  if  they  can  synchronize  directly  to  the  master  reference  node’s 
clock  and  synchronize  neighbors  if  necessary. 

4,  Synchronization  Method  Flow  Chart 

Nodes  also  use  the  reception  timestamp  matrix  to  determine  if  any  of  their 
neighbor  nodes  require  synchronization  via  RSP  by  simply  examining  whether  or  not 
their  neighbors  can  synchronize  via  R4Syn.  The  method  that  each  node  uses  to 
synchronize  with  the  rest  of  the  network  as  described  in  the  previous  sections  can  be 
represented  by  the  flow  chart  displayed  in  Figure  18.  Upon  receiving  enough  timestamp 
information,  each  node  determines  the  master  reference  node  and  calculates  its 
relative  parameters.  If  the  node  can  synchronize  to  directly  via  R4Syn,  it  adjusts  its 
clock  using  relative  parameters.  Next,  the  node  checks  its  timestamp  matrix  to  see  if  there 
are  any  neighbor  nodes  that  cannot  synchronize  to  y^^  via  R4Syn.  If  there  are 
unsynchronized  neighbors,  the  node  synchronizes  them  via  RSP  using  two  more  timing 
messages. 
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Figure  18.  Flow  chart  illustrating  the  R4Syn-RSP  hybrid  time  synchronization  protocol. 

R4Syn  is  the  primary  protocol  of  synchronization.  RSP  is  secondary. 


In  this  chapter,  we  proposed  a  new  hybrid  time  synchronization  scheme.  First,  we 
discussed  our  overall  scheme  by  which  an  unsynchronized  network  of  ad  hoc  wireless 
sensor  nodes  becomes  synchronized  through  three  major  steps:  determining  the  most 
node-inclusive  broadcast  sequence  ,  conducting  a  sequence  correction  check,  and 

synchronizing  nodes  via  RSP  or  R4Syn.  Starting  with  5^^  determination,  we  first 

presented  the  concept  behind  broadcast  sequencing  and  then  discussed  the  procedures 
that  nodes  conduct  in  order  to  determine  their  sequences.  Next,  we  demonstrated  the  need 
for  a  sequence  correction  check  for  certain  topologies  and  provided  additional  procedures 
to  adjust  the  final  sequence  that  make  it  more  inclusive.  Finally,  we  proposed  the  hybrid 
R4Syn-RSP  scheme  used  to  synchronize  the  network.  In  the  next  chapter,  we  evaluate  the 
performance  of  our  proposed  time  synchronization  scheme  through  a  series  of 
simulations. 
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IV.  SIMULATION 


In  this  chapter,  we  evaluate  the  performanee  of  our  proposed  hybrid  seheme  for 
wireless  network  time  synehronization  via  MATLAB  simulations.  We  begin  by 
examining  and  simulating  the  R4Syn  skew  and  offset  estimators  in  order  to  validate 
results  in  [11],  Next,  we  explore  the  performanee  of  the  proposed  algorithm  for 
determining  the  network  broadeast  sequenee^j^^  through  a  series  of  different  network 

simulations.  Finally,  we  apply  to  synehronize  networks  using  the  proposed  hybrid 

time  synehronization  scheme.  All  souree  eode  for  the  simulations  in  this  chapter  is 
ineluded  in  Appendix  B. 

A,  R4SYN  ESTIMATORS 

In  this  section,  we  conduet  MATLAB  simulations  to  validate  the  effeetiveness 
and  aecuraey  of  the  R4Syn  relative  skew  and  offset  estimators  proposed  in  [11]  so  that 
the  proposed  broadeast  sequenee  ean  be  applied  to  the  new  hybrid  time 
synchronization  scheme. 

1.  Simulation  Model 

We  begin  by  simulating  the  performance  of  the  estimators  via  Monte  Carlo 
simulations.  The  basic  simulation  scenario  is  presented  in  Figures  5  and  19.  The 
simulation  plaees  four  nodes  within  communieations  range  of  each  other.  Node  1  begins 
with  a  relative  offset  and  relative  skew  of  0  seeonds  and  1,  respeetively,  while  all  other 
nodes  begin  with  a  uniformly  random  relative  offset  in  the  range  of  [-10,  10]  seconds  and 
a  uniformly  random  frequency  in  the  range  of  [0.75,  1.25].  Propagation  times  are  given 
by 

t  =  ^  (25) 

prop 

where  c  =  3xl0*m/s  (speed  of  light)  and  ^  is  the  Euelidean  distanee  between  Nodes  x 
and  y.  Upon  receiving  a  beacon,  each  node’s  proeessing  time  is  modeled  as  a 
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uniformly  random  variable  in  the  range  of  [100,  500]  milliseeonds,  whieh  ineludes  all 
sourees  of  delay  (e.g.,  send/reeeive,  aeeess,  transmission/reeeption). 


2,  Results 

We  simulate  eaeh  node  transmitting  their  beaeon  upon  reeeiving  a  beaeon  from 
the  previous  node  in  sequential  order  (i.e.,  1,  2,  3,  4)  and  repeating  this  eyele  until  100 
timestamp  messages  are  generated  for  eaeh  node.  The  effeetiveness  of  the  relative  skew 
and  offset  estimators  (  and  ,  respeetively)  from  Chapter  II  is  measured  by 

ealeulating  the  mean-squared  error  and  the  Cramer-Rao  lower  bound  (CRLB)  at 
every  tenth  message.  We  denote  the  mean-squared  error  of  the  relative  skew  estimator  as 

%.(/mJ  =  E[(/m.-/J^]  (26) 

and  the  mean-squared  error  of  the  relative  offset  estimator  as 

=  (27) 

where  and  are  the  aetual  relative  skew  and  actual  relative  offset,  respectively,  that 
are  randomly  assigned  to  a  given  node  as  mentioned  in  the  previous  section.  Recall  the 
definition  of  timestamp  samples  (M;i.,v^)and  broadcast  messages  1  from  Chapter  II  that 
are  used  to  calculate  /^f^and  .  We  denote  the  CRLB  of  the  relative  skew  estimator 
as  [11] 

y  (28) 

k=\  V  k=\  y 

and  the  CRLB  of  the  relative  offset  estimator  as  [11] 

/ 

2  2 

PcAOml)^— - 7  ^  2  (29) 

El 

k=\  \k=i  J 

where  cr^  is  the  variance;  cr^  =  1  microsecond  for  this  simulation. 

We  calculate  the  mean-squared  error  and  the  CRLB  of  the  skew  and  offset 
estimators  after  every  tenth  message,  repeat  the  experiment  1000  times  and  take  the 
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average.  For  this  one-hop  network  scenario,  we  present  results  in  Figures  20  and  21  that 
match  closely  to  the  results  from  [11],  The  two  figures  demonstrate  that  of  the 

estimators  decreases  and  approaches  as  the  number  of  messages  increases. 


Figure  19.  Simulation  scenario  where  four  nodes  can  all  communicate  with  one  another. 


a 


Number  of  Messages 


Figure  20.  Mean-squared  error  of  skew  estimation  versus  number  of  messages.  As  we 
increase  the  number  of  messages,  the  mean-squared  error  of  the  relative  skew 
estimator  improves  and  approaches  the  CRLB. 


41 


Figure  21 .  Mean-squared  error  of  offset  estimation  versus  number  of  messages.  As  we 
inerease  the  number  of  messages,  the  mean-squared  error  of  the  relative 
offset  estimator  improves  and  approaehes  the  CRLB. 

We  eontinue  the  validation  by  simulating  a  multi-hop  network  seenario  as  shown 
in  Figure  22,  where  numbered  nodes  caleulate  their  loeal  one -hop  synchronization 
parameters  and  perform  multi-hop  synchronization  on  demand,  similar  to  the  multi-hop 
network  in  [11],  For  example.  Node  4  is  three  link-hops  away  from  Node  1;  thus,  it  must 
receive  local  synchronization  parameters  from  Nodes  1,  2,  and  3  to  perform  multi -hop 
synchronization. 


Figure  22.  Multi-hop  network  scenario 
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The  results  in  Figure  23  show  that  the  mean-squared  error  for  the  multi-hop  skew 
estimator  improved  as  the  number  of  messages  increased  even  with  a  higher  number  of 
hop  values,  as  expected.  The  simulation  results  also  validate  that  the  mean-squared  error 
is  kept  at  an  acceptable  range  for  a  small  number  of  messages  as  well  as  a  large  number 
of  hops. 


1  O^V^lO  20 

Number  of  Hops  ,,  , 

^  Number  of  Messages 


Figure  23.  Mean-squared  error  of  multi-hop  skew  estimation  versus  number  of 
messages.  As  we  increase  the  number  of  messages  and  hops,  the  mean- 
squared  error  of  the  multi-hop  skew  estimator  is  kept  at  an  acceptable  range 

for  time  synchronization. 

Through  our  simulation  results,  we  validate  how  the  proposed  estimators’  mean- 
squared  errors  decrease  and  approach  the  CRLB  as  we  increase  the  number  the 
timestamp  messages  for  the  one-hop  scenario  and  that  the  mean-squared  errors  provide 
an  acceptable  range  of  accuracy  regardless  of  the  number  of  hops  or  messages.  This  leads 
us  to  affirm  that  the  estimators  are,  in  fact,  an  effective  and  accurate  tool  for  time 
synchronization. 
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B,  BROADCAST  SEQUENCING  PERFORMANCE 

In  this  section,  we  discuss  the  simulation  used  to  evaluate  the  proposed  algorithm 
for  determining  as  well  as  the  sequence  correction  check.  Summaries  of  our  results 
are  shown  in  Tables  2  and  3. 

1.  Simulation  Model 

We  must  first  describe  the  formation  of  dense  and  sparse  network  topologies  in 
the  simulations.  Both  types  of  networks  start  with  the  first  node  centered  at  the  origin  of  a 
Cartesian  grid,  and  all  nodes  are  assumed  to  have  the  same  maximum  communications 
range  of  100  meters.  For  dense  networks,  every  subsequent  node  is  randomly  deployed 
within  33-66  meters  of  the  previous  node’s  location.  For  sparse  networks,  every 
subsequent  node  is  randomly  deployed  within  66-99  meters  of  the  previous  node’s 
location.  This  methodology  ensures  that  every  node  can  communicate  with  at  least  one 
other  node  and  that  the  network  can  form  a  diverse  series  of  topologies  for  analysis.  For 
dense  networks,  the  average  number  of  neighbors  per  node  was  between  60  percent  and 
88  percent  of  the  total  number  of  nodes  in  the  network,  while  the  average  number  of 
neighbors  per  node  for  sparse  networks  was  between  8  percent  and  32  percent. 

We  begin  by  forming  a  dense  network  of  A  =  5  nodes  that  are  deployed  with  the 
ability  to  communicate  at  least  with  one  other  node  as  shown  in  Figure  24.  Let  us  assume 
that  one-hop  neighbor  discovery  is  complete  so  that  all  nodes  know  the  IDs  of  their  one- 
hop  neighbors.  Say  Node  1  starts  with  the  role  of  and  floods  the  network  to  begin 
node  relationship  and  sequence  determinations.  Childless  nodes  determine  their 
sequences  first  and  then  pass  their  sequences,  F^  ,  and  Np  to  their  parent  nodes  as 
discussed  in  Chapter  III.  This  continues  until  receives  all  of  the  information  it  needs 
to  determine  .  We  denote  the  number  of  nodes  included  in  S^p  before  sequence 
correction  as  A^^^and  measure  our  algorithm’s  sequence  forming  performance  before 
sequence  correction  as 
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(30) 


p  =i^xl00% 

BSC 

where  N  is  the  total  number  of  nodes. 

After  cJ^^is  determined,  we  simulate  the  network  adjusting  (as  necessary)  and 
forwarding  throughout  the  network  per  the  sequence  correction  method  in  Chapter  III. 
We  denote  the  number  of  nodes  included  in  after  sequence  correction  as  A^^^and 
measure  our  algorithm’s  sequence  forming  performance  after  sequence  correction  as 

(31) 


Figure  24.  Example  topology  of  a  dense  network  of  five  nodes. 

We  distribute  the  role  of  throughout  the  network  for  this  topology,  repeat  the 
process  for  a  total  of  100  newly-generated  topologies,  and,  finally,  average  P^^^^andP^^^ 
across  the  total  number  of  trials  to  obtain  the  results  provided  in  the  next  section.  For 
every  new  topology  that  is  generated,  the  location  of  each  node  after  the  deployment  of 
the  first  node  (at  the  origin)  is  a  new  randomly-generated  Cartestian  grid  location;  thus, 
the  distances  between  nodes  vary  for  each  topology.  We  repeat  the  simulation  for  dense 
networks  while  varying  N  from  5,  10,  15,  20,  30,  40,  to  50  and  then  do  the  same  process 
for  sparse  networks.  Intuitively,  networks  with  more  nodes  will  yield  more  topology 
variation. 
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2. 


Results 


A  summary  of  the  results  for  dense  networks  is  displayed  in  Table  2.  Our 
algorithm  for  determining  before  sequence  correction  performed  significantly  well 

independent  of  the  number  of  nodes  in  the  networks.  The  sequence  correction  check 
improved  the  sequence  forming  performance  to  or  very  close  to  100  percent  of  the  total 
number  of  nodes  in  the  network. 


Table  2.  Summary  of  results  for  dense  networks  before  and  after  sequence 

correction.  The  broadcast  sequencing  algorithm  proved  to  be  effective  in 
including  as  many  nodes  as  possible  for  dense  networks. 


Dense  Networks 

Trials  =  Nodes  x  Topologies 

Pbsc 

Pasc 

Nodes 

5 

Topologies 

100 

99.28% 

99.52% 

Trials 

500 

Nodes 

10 

Topologies 

100 

99.46% 

100.00% 

Trials 

1000 

Nodes 

15 

Topologies 

100 

99.40% 

99.99% 

Trials 

1500 

Nodes 

20 

Topologies 

100 

99.32% 

99.99% 

Trials 

2000 

Nodes 

30 

Topologies 

100 

99.68% 

100.00% 

Trials 

3000 

Nodes 

40 

Topologies 

100 

99.75% 

100.00% 

Trials 

4000 

Nodes 

50 

Topologies 

100 

99.66% 

100.00% 

Trials 

5000 
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For  sparse  networks,  the  performanee  of  the  algorithm  before  sequenee 

eorreetion  deteriorated  as  we  inereased  the  number  of  nodes  in  the  network  as  shown  in 
Table  3;  however,  the  sequenee  eorreetion  algorithm  was  able  to  add  nodes  into  the 
original  sequenee,  inereasing  the  overall  percentage  to  a  more  acceptable  5^^^ . 


Table  3.  Summary  of  results  for  sparse  networks  before  and  after  sequence 

correction.  The  sequence  correction  algorithm  proved  to  be  effective  in 
including  as  many  nodes  as  possible  for  sparse  networks. 


Sparse  Networks 

Trials  =  Nodes  x  Topologies 

Pbsc 

Pasc 

Nodes 

5 

Topologies 

100 

99.08% 

100.00% 

Trials 

500 

Nodes 

10 

Topologies 

100 

94.25% 

98.03% 

Trials 

1000 

Nodes 

15 

Topologies 

100 

88.84% 

95.41% 

Trials 

1500 

Nodes 

20 

Topologies 

100 

82.34% 

92.92% 

Trials 

2000 

Nodes 

30 

Topologies 

100 

72.76% 

88.50% 

Trials 

3000 

Nodes 

40 

Topologies 

100 

67.65% 

85.63% 

Trials 

4000 

Nodes 

50 

Topologies 

100 

60.96% 

83.28% 

Trials 

5000 

In  this  section,  we  described  the  methodology  behind  the  simulations  for 
determining  and  presented  results  of  the  algorithm’s  performance.  The  algorithm 
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performed  well  for  dense  networks  without  a  sequence  correction  check  but  deteriorated 
for  sparse  networks  as  we  increased  the  number  of  nodes.  The  simulations  for  sparse 
networks  validated  the  usefulness  and  need  for  a  sequence  correction  check  for  the 
overall  scheme. 

C.  NETWORK  TIME  SYNCHRONIZATION  USING  HYBRID  SCHEME 

In  this  section,  we  evaluate  the  implementation  of  in  the  proposed  hybrid 
time  synchronization  scheme  for  any  network  topology.  We  describe  the  different 
simulation  models  used  to  investigate  the  effects  of  increasing  hop  counts  from  the 
master  reference  node  and  the  effects  of  node  density  on  the  overall  precision  of  the 

network’s  time  synchronization.  We  present  results  to  validate  the  performance  of  our 
proposed  hybrid  time  synchronization  scheme  for  any  network  topology. 

1.  Effect  of  Hop  Counts  on  Network  Synchronization 

We  begin  evaluating  the  hybrid  time  synchronization  scheme  by  exploring  the 
effects  of  hop  counts  from  on  the  overall  precision  of  the  network’s  synchronization. 
We  present  the  simulation  model  and  results  in  this  section. 

a.  Simulation  Model 

We  form  the  simulation  model  by  creating  a  linear  network  of  22  nodes,  as 
displayed  in  Figure  25.  The  broadcast  sequencing  method  outputs  a  final  sequence  of 
{1,2,3,. ..,22}  and  then  nodes  broadcast  in  the  order  of  for  10  cycles,  generating  their 

reception  timestamp  matrix  T  from  (18)  in  Chapter  III.  We  choose  10  cycles  in  order  to 
produce  a  sufficient  number  of  messages  to  demonstrate  whether  a  synchronization  trend 
exists.  We  force  Node  1  to  be  y^^  so  that  only  odd-numbered  nodes  can  synchronize 

directly  to  Node  1  via  R4Syn,  while  even-numbered  nodes  are  synchronized  by  odd- 
numbered  nodes  via  RSP.  Nodes  synchronize  their  clocks  after  every  tenth  cycle,  and  we 
obtain  each  node’s  clock  precision  to  y^^  as  well  as  the  network’s  average  clock 
precision  to  y^^ .  In  this  linear  network  of  22  nodes,  there  is  a  10-hop  maximum  for 
R4Syn  synchronization. 
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Figure  25.  Linear  network  of  22  nodes. 

After  observing  the  precision  of  the  network’s  time  synchronization,  we  move 
two  of  the  farthest  nodes  from  (Nodes  21  and  22)  within  range  of  to  form  a 

topology  shown  in  Figure  26,  where  the  maximum  R4Syn  hop  from  is  now  nine 
hops.  We  continue  this  trend,  conducting  100  simulations  for  each  topology,  until  all 
nodes  are  within  range  of  .  The  results  are  detailed  in  the  following  subsection. 


Figure  26.  An  example  of  the  iterative  change  in  topology  used  to  analyze  the  effect  of 

hop  count  on  network  precision. 

b.  Results 

After  conducting  100  simulations  for  the  linear  network  of  22  nodes,  we  obtain 
the  results  shown  in  Figure  27.  Nodes  synchronizing  via  R4Syn  obtain  tenths  of 
nanosecond  precision  to  ‘s  clock,  whereas  nodes  synchronizing  via  RSP  maintain 

close  to  0.5  jUs  precision  to  ‘s  clock  .  We  observe  that  when  a  node  is  a  small 

number  of  hops  away  from  for  R4Syn  synchronization,  its  clock  is  more  precisely 

synchronized  to  ‘s  clock  as  shown  in  Figure  28. 

49 


Figure  27. 


Figure  28. 
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Synchronization  results  of  100  topologies  of  a  linear  network  of  22  nodes. 
Nodes  synchronizing  via  R4Syn  obtain  tenths  of  nanosecond  precision, 
whereas  nodes  synchronizing  via  RSP  maintain  a  0.5  //5  precision. 


Number  of  hops  versus  precision  for  linear  network  of  22  nodes.  Node 
precision  slightly  deteriorates  when  the  number  of  hops  from  the  master 
reference  node  increases  for  nodes  synchronizing  via  R4Syn. 
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While  we  may  get  near  the  tenths  of  nanosecond  precision  for  individual  nodes 
synchronizing  via  R4Syn,  we  get  the  poorest  results  for  the  network’s  precision  as  a 
whole  as  shown  in  Figure  29.  As  we  changed  the  topologies  by  moving  the  two  farthest 
nodes  within  range  of  and  observing  the  network’s  clock  precision  to  ,  we 
obtained  the  results  in  Figure  29.  As  expected,  the  average  network  synchronization 
improves  when  we  have  a  small  number  of  nodes  that  are  multiple  hops  away  from  . 


Number  of  Hops 


Figure  29.  Network  synchronization  for  different  topologies.  Synchronization  improves 
when  less  nodes  are  multiple  hops  away  from  the  master  reference  node. 


When  all  nodes  are  within  range  of  y^^ ,  we  consistently  obtain  the  precision 
results  in  the  tens  of  nanoseconds  range  as  displayed  in  Figure  30.  For  the  network  as  a 
whole,  synchronization  precision  is  the  highest  when  all  nodes  are  within 
communications  range  of  one  another. 
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Figure  30.  Synchronization  results  for  a  fully-connected  network  where  all  nodes  can 
communicate  with  one  another.  After  one  cycle,  the  synchronization 
precision  is  49  nanoseconds.  As  we  increase  the  number  of  cycles, 
synchronization  precision  improves. 

2,  Effects  of  Network  Density  on  Network  Synchronization 

Next,  we  explore  the  effects  of  network  density  on  the  overall  precision  of  the 
network.  Accordingly,  we  present  the  network  density  simulation  model  and  results  in 
this  section. 


a.  Simulation  Model 

We  measure  the  network  density  by  the  average  number  of  neighbors  per  node  for 
any  given  topology.  We  also  investigate  the  performance  of  our  overall  time 
synchronization  scheme  of  determining  a  network  broadcast  sequence,  performing 
sequence  correction,  and  then  synchronizing  via  R4Syn  or  RSP.  To  simulate  this,  we 
generate  the  same  two  types  of  networks  (sparse  and  dense)  that  we  used  in  the  previous 
section  to  evaluate  .  After  the  nodes  are  deployed  and  discover  their  one-hop 
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neighbors,  the  starter  node  is  arbitrarily  selected  to  flood  the  network  with  a 
broadcast  sequence  initiation  message.  Once  determination  of  is  complete,  nodes 
conduct  a  sequence  correction  check  and  broadcast  messages  for  ten  cycles, 
synchronizing  their  clocks  to  after  every  tenth  cycle.  Along  the  lines  of  the  previous 

section,  we  choose  ten  cycles  because  a  sufficient  number  of  messages  are  produced  to 
demonstrate  whether  a  synchronization  trend  exists. 

b.  Results 

We  began  with  sparse  networks  of  25  nodes  and  observed  the  network 
synchronization  statistics  for  100  newly-generated  topologies.  We  choose  100  as  the 
number  of  topologies  because  it  provided  a  reasonable  amount  of  data  without  consuming 
an  excessive  amount  of  time  to  complete  simulations.  The  simulation  results  in  Figure  31 
validate  that  as  the  number  of  hops  increases,  the  average  precision  deteriorates,  as 
expected  from  the  previous  section.  After  one  cycle,  the  network  maintains 
synchronization  of  less  than  0.1  //5  precision. 
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Figure  3 1 .  Average  synchronization  of  100  newly-generated  topologies  of  25-node 
sparse  networks.  After  one  cycle,  the  network  maintains  synchronization  of 

less  than  0.1  //5  precision. 
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We  increased  the  number  of  nodes  to  50  and  repeated  the  simulation  for  sparse 
networks.  The  results  in  Figure  32  show  that  as  the  number  of  nodes  in  the  network 
doubled,  the  average  network  precision  slightly  deteriorated  but  is  kept  at  an  acceptable 
range.  On  average,  the  network  maintains  synchronization  of  less  than  0.1  //5  precision 
after  about  four  cycles. 
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Figure  32.  Average  synchronization  of  100  newly-generated  topologies  of  50-node 
sparse  networks.  After  about  four  cycles,  the  network  maintains 
synchronization  of  less  than  0.\  /us  precision. 


We  continued  our  simulations  for  dense  networks  of  25  nodes.  The  simulation 
results  in  Figure  33  demonstrate  that  on  average,  it  takes  about  four  cycles  for  dense 
networks  to  maintain  synchronization  of  less  than  0.1  /us  precision. 
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Figure  33.  Average  synchronization  of  100  newly-generated  topologies  of  25-node 
dense  networks.  After  about  four  cycles,  the  network  maintains 
synchronization  of  less  than  0.1  /us  precision. 


We  increased  the  number  of  nodes  to  50  and  repeated  the  simulation  for  dense 
networks.  The  results  in  Figure  34  show  that  as  the  number  of  nodes  in  the  network 
doubled,  the  average  network  precision  slightly  deteriorated  similarly  to  sparse  networks 
but  is  still  kept  at  an  acceptable  range.  On  average,  the  network  reached  synchronization 
of  less  than  0.1  /us  precision  after  about  ten  cycles. 


Figure  34.  Average  synchronization  of  100  newly-generated  topologies  of  50-node 
dense  networks.  On  average,  these  networks  required  at  least  ten  cycles  to 

reach  0.1  /us  precision. 
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Next,  we  compared  the  network  densities  (average  number  of  neighbors  per  node) 
for  the  two  types  of  networks  and  found  that  there  was  little  variability  in  the  average 
network  synchronization.  The  majority  of  topologies  for  25 -node  sparse  networks 
reached  an  average  synchronization  precision  of  less  than  0.\  /us  as  shown  in  Figure  35. 


Figure  35.  Node  density  versus  average  clock  precision  for  sparse  networks  of  25  nodes. 

The  majority  of  topologies  maintained  synchronization  of  less  than  0.\  /us  . 

When  we  compared  the  average  synchronization  of  25 -node  sparse  networks  to 
25-node  dense  networks,  we  found  that  the  majority  of  dense  topologies  reached  an 
average  synchronization  of  around  0.1  /us  as  shown  in  Figure  36,  which  is  not  a 
significant  difference. 
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Figure  36.  Node  density  versus  average  clock  precision  for  dense  networks  of  25  nodes. 

The  majority  of  topologies  maintained  synchronization  of  around  0.1  /us  . 

When  the  number  of  nodes  was  increased  to  50  for  sparse  networks,  the  majority 
of  topologies  reached  an  average  synchronization  of  more  than  0.1  //5  as  shown  in  Figure 
37,  which  is  a  decline  compared  to  networks  of  25  nodes  (see  Figure  35). 

When  the  number  of  nodes  was  increased  to  50  for  dense  networks,  the  majority 
of  topologies  reached  an  average  synchronization  of  about  0.2  /us  as  shown  in  Figure  38, 
which  is  also  a  decline  compared  to  networks  of  25  nodes  (see  Figure  36). 

Although  these  simulation  results  demonstrated  that  a  network’s  time 
synchronization  degrades  as  the  number  of  nodes  increases  using  the  hybrid  scheme,  the 
average  level  of  precision  for  each  network  was  higher  than  other  time  synchronization 
methods  regardless  of  network  topology. 
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Figure  37.  Node  density  versus  average  elock  precision  for  sparse  networks  of  50  nodes. 

The  majority  of  topologies  maintained  synchronization  of  slightly  more  than 
0.1  //5 ,  a  decline  from  25  node  networks. 


Figure  38.  Node  density  versus  average  clock  precision  for  dense  networks  of  50  nodes. 

The  majority  of  topologies  maintained  synchronization  of  about  0.2  ,  a 

decline  from  25  node  networks. 
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In  this  chapter,  MATLAB  simulations  were  conducted  to  evaluate  the 
performance  of  our  proposed  hybrid  seheme  for  wireless  network  time  synchronization. 
We  first  validated  the  R4Syn  skew  and  offset  estimators  presented  in  Chapter  II.  Next, 
we  presented  a  series  of  simulations  to  test  the  performanee  of  determination  and 

demonstrate  the  utility  of  a  sequenee  eorreetion  eheek.  Finally,  we  explored  the 
performanee  of  the  proposed  hybrid  seheme  using  broadeast  sequencing  through  another 
series  of  simulations.  The  results  demonstrate  that  our  proposed  hybrid  seheme  improves 
average  network  synehronization  over  other  existing  time  synehronization  methods 
regardless  of  network  topology. 
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V.  CONCLUSIONS 


In  this  thesis,  we  explored  the  ehallenges  assoeiated  with  time  synehronization  in 
wireless  sensor  networks,  sueh  as  the  possibility  of  eollisions  and  topology  ehanges.  A 
review  of  related  literature  revealed  that  other  methods  exist  for  addressing  these 
challenges,  to  include  RSP  and  R4Syn,  which  we  incorporated  in  to  our  proposed  hybrid 
time  synchronization  scheme.  To  address  the  drawbacks  of  the  other  methods,  a  new 
algorithm  for  determining  a  network  broadcast  sequence  for  a  wireless  sensor  network 
was  proposed  and  developed  to  eliminate  the  possibility  of  collisions.  Additionally,  a 
model  to  check  and  adjust  the  broadcast  sequence  for  potential  errors  was  presented. 
Finally,  a  new  hybrid  time  synchronization  scheme  of  RSP  and  R4Syn  based  on  the  new 
broadcast  sequence  developed  in  this  thesis  was  proposed. 

Simulation  models  were  developed  to  validate  the  estimators  proposed  in  R4Syn 
and  evaluate  the  performances  of  our  network  broadcast  sequencing  algorithm  and  our 
new  hybrid  time  synchronization  scheme.  Simulation  results  demonstrated  that  our 
algorithms  for  determining  the  broadcast  sequence  and  for  the  sequence  correction  were 
effective  in  producing  a  final  broadcast  sequence  with  a  high  percentage  of  nodes. 
Simulation  results  validated  that  for  any  topology,  the  network’s  time  synchronization  is 
more  precise  using  our  new  hybrid  time  synchronization  scheme  than  other  known  time 
synchronization  protocols. 

A,  SIGNIFICANT  CONTRIBUTIONS 

Three  main  contributions  were  made  in  this  thesis.  In  order  to  address  the 
possibility  of  collisions  using  R4Syn,  a  new  scheme  that  determined  a  specific  sequence 
order  and  eliminated  collisions  was  presented.  Our  new  algorithms  for  determining  a 
specific  network  broadcast  sequence  and  for  sequence  correction  solved  the  potential 
collision  problem  that  is  inherent  in  wireless  sensor  networks. 

We  introduced  a  new  method  of  determining  a  master  reference  node  to 
synchronize  to  and  performing  multi-hop  synchronization  using  an  analysis  of  time  stamp 
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information.  This  eliminates  the  need  for  on-demand  synehronization,  whieh  leads  to 
more  transmissions  and  a  higher  probability  of  eollisions. 

Finally,  we  presented  a  new  hybrid  time  synehronization  seheme  that  approaehed 
an  average  network  time  synehronization  in  the  nanoseeond  range  for  any  topology, 
whereas  other  known  synehronization  methods  offer  time  synehronization  in  the 
mieroseeond  range.  For  example,  the  average  network  synehronization  after  one  cyele 
was  approximately  49  nanoseeonds  in  a  fully-eonneeted  network  where  all  nodes  are 
within  eommunications  range  of  one  another.  For  this  type  of  network,  each  node  only 
has  to  transmit  two  broadcasts  in  one  cycle  after  sequence  determination  to  achieve  such 
a  high  level  of  precision.  The  average  network  synchronization  for  multi-hop  networks  of 
25  nodes  was  approximately  81  nanoseconds  after  three  cycles,  which  equates  to  an 
individual  node  broadcasting  no  more  than  eight  messages  after  sequence  determination 
to  achieve  that  level  of  precision. 

B,  RECOMMENDED  FUTURE  WORK 

In  this  thesis,  we  explored  a  new  hybrid  time  synchronization  scheme  for  wireless 
sensor  networks.  Simulations  verified  the  validity  of  our  proposed  scheme  but  can  be 
extended  to  explore  the  energy  usage  and  consumption  during  each  cycle  of  broadcasting 
as  well  as  during  computing.  These  results  can  be  used  in  conjunction  with  load 
balancing  techniques  to  develop  optimum  power  management  techniques  for  energy 
savings.  The  simulations  in  this  thesis  validated  network  synchronization  for  static  ad  hoc 
wireless  sensor  networks  in  which  nodes  remain  in  the  same  location  after  deployment. 
Additional  simulations  can  be  undertaken  to  examine  node  mobility  using  our  hybrid 
time  synchronization  scheme  and  explore  the  effects  of  dynamic  topology  changes  on 
both  the  synchronization  and  the  power  consumption  of  a  network. 

The  work  in  this  thesis  is  all  based  on  simulations.  Future  implementation  on 
sensor  motes  (hardware)  should  be  conducted  to  further  investigate  the  accuracy  of  our 
claims  and  verify  our  results.  The  other  recommended  research  areas  such  as  energy 
savings  and  node  mobility  using  our  hybrid  scheme  should  be  compared  to  other  time 
synchronization  methods  using  sensor  motes  as  well. 
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APPENDIX  A.  ADDITIONAL  FLOW  CHARTS 


Additional  flow  charts  used  for  sequence  determination  from  Chapter  III  are 
provided  in  this  appendix. 


Figure  39.  Flow  chart  to  find  the  ehild  node  with  the  longest  sequence. 
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Figure  40.  Flow  chart  to  add  a  parent  or  friend  node  to  a  sequence. 
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Figure  41 .  Flow  chart  to  find  the  node  with  the  shortest  sequence. 
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Figure  42.  Flow  chart  updating  S{X)  and  . 


To  clarify  the  operation  that  requires  in  Figures  43-45,  let 

={5,4,3,2,1}  and  =  {7, 8, 3, 9, 6}  ;  (libefore  first  similarity  with 
refers  to  the  sequence  {5, 4}  since  the  first  similarity  between  and  is  Node  3,  so 
^Temp  is  adjusted  to  only  include  {5,4} . 
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Is  the  similarits'  at 
the  beginning  of 
both 
SPQ  and 


Yes 


Figure  43.  First  flow  chart  adjusting  S(X)  for  similarities. 
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Figure  44.  Second  flow  chart  adjusting  S{X)  for  similarities. 
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Figure  45.  Third  flow  chart  adjusting  diX)  for  similarities. 
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APPENDIX  B.  SIMULATION  SOURCE  CODE 


Source  codes  for  the  simulations  conducted  in  Chapter  fV  of  this  thesis  are 
provided  in  this  appendix. 

A,  MATLAB  VALIDATION  OF  R4SYN  ESTIMATORS  FILE 

The  MATLAB  source  code  presented  in  this  section  can  be  used  to  test  the  R4Syn 
estimators  presented  in  Chapter  II  and  Chapter  IV  of  this  thesis.  The  code  can  only  be  run 
to  simulate  four  nodes  broadcasting  for  ten  cycles  for  the  one-hop  scenario.  For  the  multi¬ 
hop  scenario,  the  code  can  only  be  run  to  simulate  up  to  ten  hops. 


%  Validation  of  R4Syn  estimators 

clc,  clear  all,  close  all 

%initialize  values 
N  =  4;  %number  of  nodes 

J  =  51;  %total  number  of  eycles  needed  for  Node  2’s  calculations 
S  =  1000;  %number  of  measurements 
sigma  =  le-6; 

%B  =  10;  %number  of  hops  %un-comment  for  multi-hop 

%TotalMSEskew  =  zeros(B,10);  %un-comment  for  multi-hop 

SumMSEskew  =  zeros(l,10);  SumMSEoffset  =  zeros(l,10); 
SumCRLBskew  =  zeros(l,10);  SumCREBoffset  =  zeros(l,10); 

%for  rrr=  1 ;  S  %un-comment  for  multi-hop 

%  MH  ActualSkew  =  zeros(l,B);  %un-comment  for  multi-hop 

%  MH  Actual  Skew  =  [];  %un-comment  for  multi-hop 

%  XXX  =  cell(B,l);  %un-comment  for  multi-hop 

%  for  MH=1  :B  %un-comment  for  multi-hop 

for  iii=  1 :  S  %remove  for  multi-hop 

EinalMSEskew  =  [];  %remove  for  multi-hop 
EinalMSEoffset  =  [];  %remove  for  multi-hop 
EinalCRLBskew  =  [];  %remove  for  multi-hop 
EinalCRLBoffset  =  [];  %remove  for  multi-hop 
%set  distance  between  nodes 
d  =  zeros(N,N); 
for  i=l:N 
for  k=l;N 
if  i~=k  &&  k>i 

d(i,k)  =  90  +  sqrt(5).*randn(l,l); 
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d(k,i)  =  d(i,k); 
else 
end 
end 
end 

%proeessing  times 

XX  =  100;  yy  =  500; 

t_p  =  XX  +  (yy-xx).*rand(l,N); 

t_proc  =  t_p*(le-3); 

%propagation  times 
c  =  3e8; 

t_prop  =  zeros(N,N); 
for  i  =  1  ;N 
for  k  =  1  :N 
t_prop(i,k)  =  d(i,k)./c; 
t_prop(k,i)  =  t_prop(i,k); 
end 
end 

%set  random  frequencies 
r  =  -.25;  q  =  .25; 

F  =  r  +  (q-r).*rand(l,N); 
f  =  1  +F; 

%relative  skew  matrix  (saved  for  MSB  calc) 

RelSkew  =  ones(N,N); 
for  i  =  1  ;N 
for  k  =  1  :N 

RelSkew(i,k)  =  f(k)./f(i); 
end 
end 

sk  =  RelSkew; 

NodelClock  =  0; 

X  =  -10;  y  =  10; 

RandOffset  =  x  +  (y-x).*rand(l,N-l); 

StartOffset  =  NodelClock  +  RandOffset; 

%simulate  first  cycle  of  timestamps 
IS  =  zeros(N,N); 
for  i  =  1;N-1 

TS(i+l,l)  =  StartOffset(i)  +  t_prop(l,i+l)*sk(l,i+l); 
end 

TS(  1, 2)  =  NodelClock  +  (t_proc(2)  +  2*t_prop(l,2))*sk(l,2); 
for  i  =  1  ;N-2 

TS(l,i+2)  =  TS(l,i+l)  +  (t_proc(i+2)  +  t_prop(l,i+2))*sk(l,i+2); 
end 

for  1=2  ;N 
for  k=2;N 
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ifi==k 
TS(i,k)  =  0; 
elseif  i  ==  k-1 

TS(i,k)  =  TS(i,k-2)  +  (t_proc(i)  +  t_proc(k)  +  (2*t_prop(i,k)))*sk(i,k); 
else 

TS(i,k)  =  TS(i,k-l)  +  (t_proe(k)  +  t_prop(i,k))*sk(i,k); 
end 
end 
end 

%simulate  the  rest  of  the  timestamps  for  J  eyeles 
for  h  =  2  :  J 
TS  =  [TS  zeros(N,N)]; 
for  i=l;N 

for  k  =  ((h-l)*N)+l  ;  h*N 
ifi==  k-(h-l)*N 
TS(i,k)  =  0; 

elseif  i  ==  k  -(N*(h-1)+1) 

TS(i,k)  =  TS(i,k-2)  +  (t_proe(i)+t_proc(i+l)  +  (2*t_prop(i,i+l)))*sk(i,i+l); 
elseif  i  ==  (k-1)  -  (h-2)*N 

TS(i,k)  =  TS(i,k-2)  +  (t_proe(l)+t_proc(i)  +  (2*t_prop(i,l)))*sk(i,l); 
else 

TS(i,k)  =  TS(i,k-l)  +  (t_proe(k-(h-l)=>=N)  +  t_prop(i,  k-(h-l)*N))*sk(i,k-(h-l)*N); 
end 
end 
end 
end 

%initialize  zero  matrix  for  eaeh  node 
for  i  =  1  ;N 

Node{i}  =  zeros(N,N); 
for  k  =  1:J-1 

Node{i}  =  [Nodeji}  zeros(N,N)]; 
end 
end 

for  i  =  2;N 

Node{i}(i,l)  =  TS(i,l); 
end 

for  k  =  2;N 
for  1=1  ;N 
if  i~=k 

Node{i}(k,l:k-l)  =  TS(k,l:k-l); 

Node{i}(i,k)  =  TS(i,k); 
else  eontinue 
end 
end 
end 
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for  h  =  2  :  J 
for  k  =  1  :N 
for  i=l:N 
if  i~=k 

Node{i}(k,((h-l)*N+k)-3  :  ((h-l)*N+k)-l)  =  TS(k,((h-l)*N+k)-3  :  ((h-l)*N+k)-l); 
Node{i}(i,(h-l)*N+k)  =  TS(i,(h-l)*N+k); 
else  eontinue 
end 
end 
end 
end 

%gathering  values  for  offset/skew  ealeulations 
for  gg=6:5:51 
for  1=1  :N 

values{i}  =  oell(N,2); 
end 

for  1=1  ;N 
for  k  =  1  :  gg  *  N 
ifNode{i}(i,k)  ~=  0 
for  m=l;N 

if  Node{i}(m,k)~=0  &&  m~=i 
values {1}  {m,l}  =  [values {1}  {m,l}  Node{i}(m,k)]; 
values {1}  {m, 2}  =  [values{i}  {m,2}  Node{i}(i,k)]; 
else  eontinue 
end 
end 

else  eontinue 
end 
end 
end 

EstimatorSkew  =  ones(N,N); 

EstimatorOffset  =  zeros(N,N); 
for  ii=l:N 
for  kk=l;N 
u  =  values  {ii}  {kk,l}; 

V  =  values  {ii}  {kk,2}; 
if  length(u)>l 
K  =  length(u); 

%ealculate  estimators  per  R4Syn 

skew  =  (sum(u)*sum(v)  -  K*(u*v’))  /  ((sum(v)).^2  -  K*sum(v.^2)); 
offset  =  (1/K)  *  (  sum(u)-(skew*sum(v)) ); 

EstimatorSkew(ii,kk)  =  skew; 

EstimatorOffset(ii,kk)  =  offset; 

skewCREB  =  (K*sigma^2)  /  ((K*sum(v.^2))  -  ((sum(v)).^2))  ; 
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offsetCRLB  =  ((sigma^2)*(sum(v.^2)))  /  ((K*sum(v.^2))  -  ((sum(v)).^2))  ; 
CRLBskewMatrix(ii,kk)  =  skewCRLB; 

CRLBoffsetMatrix(ii,kk)  =  offsetCRLB; 
else  continue 
end 
end 
end 

%  ######UN-COMMENT  THE  FOLLOWING  SECTION  FOR  MULTI-HOP####### 
%XXX{MH}  =  [XXX{MH}  EstimatorSkew(2,I)]; 

%end 
%  end 

%  MSEskewHop=cell(B,l); 

%MH_Est_Skew  =  []; 

%for  aa  =  I:B 
%if  aa  ==  I 

%  MH_Est_Skew  =  XXX{  I } ; 

%else 

%  MH_Est_Skew  =  MH_Est_Skew.*XXX{aa}; 

%  end 

%  MSEskewHop{aa}  =  (MH_ActualSkew(aa)  -  MH_Est_Skew)A2; 

%end 

%Z=  zeros(B,I0); 

%for  i=I:B 

%  Z(i,:)  =  MSEskewHop{i}; 

%end 

%  TotalMSEskew  =  TotalMSEskew  +  Z; 

%end 

%AverageMSEfreq  =  TotalMSEskew./S; 

%figure() 

%surf(AverageMSEfreq) 

%set(gca,  ‘XScale’,  ‘linear’,  ‘YScale’,  ‘linear’,  ‘ZScale’,  ‘log’) 

%xlabel(‘Number  of  Messages’),  ylabel( ‘Number  of  Hops’),  zlabel(‘MSE’) 

%grid  on 

%  #########END  UN-COMMENTED  SECTION  FOR  MULTI-HOP######### 
RelOffset  =  zeros(N,N); 
for  i=I;N 

for  p  =  (gg-I)  *  N;  gg*N  -  I 
for  k=I;N 
if  i==k 

RelOffset(i,k)=0; 
elseif  TS(i,p)~=0  &&  TS(k,p)~=0 
RelOffset(i,k)  =  TS(k,p)  -  RelSkew(i,k)*TS(i,p); 
else  continue 
end 
end 
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end 

end 

MSEskew  =  (RelSkew  -  EstimatorSkew).^2; 

MSEoffset  =  (RelOffset  -  EstimatorOffset).^2; 

EinalMSEskew  =  [EinalMSEskew  MSEskew(2,l)]; 

EinalMSEoffset  =  [EinalMSEoffset  MSEoffset(2,l)]; 

EinalCREBskew  =  [EinalCRLBskew  CRLBskewMatrix(2,l)]; 

EinalCREBoffset  =  [FinalCRLBoffset  CRLBoffsetMatrix(2,l)]; 
end 

SumMSEskew  =  SumMSEskew  +  EinalMSEskew; 

SumMSEoffset  =  SumMSEoffset  +  EinalMSEoffset; 

SumCRLBskew  =  SumCRLBskew  +  EinalCRLBskew; 

SumCRLBoffset  =  SumCRLBoffset  +  FinalCRLBoffset; 
end 

AverageMSEskew  =  SumMSEskew./S; 

AverageMSEoffset  =  SumMSEoffset./S; 

AverageCRLBfreq  =  SumCRLBskew./S; 

AverageCRLBoffset  =  SumCRLBoffset./S; 

X=  10:10:100; 
figureO 

semilogy(X,  AverageMSEskew,  ‘bo-’,  X,  AverageCRLBfreq, ’rx:’) 
xlabel( ‘Number  of  Messages’),  ylabel(‘MSE’) 
legend(‘MSE’,  ‘CRLB’,  ‘loeation’,  ‘northeast’) 
figureO 

semilogy(X,  AverageMSEoffset, ’bo-’,  X,  AverageCRLBoffset, ’rx:’) 
xlabel( ‘Number  of  Messages’),  ylabel(‘MSE  (see)’) 
legend(‘MSE’,  ‘CRLB’,  ‘loeation’,  ‘northeast’) 

B.  MATLAB  BROADCAST  SEQUENCING  AND  HYBRID  TIME 
SYNCHRONIZATION  SIMULATION  FILE 

The  MATLAB  souree  code  presented  in  this  section  can  be  used  to  test  the 

broadcast  sequencing  and  hybrid  time  synchronization  scheme  presented  in  Chapter  III 

and  Chapter  IV  of  this  thesis.  The  broadcast  sequencing  code  is  run  by  changing  the 

number  of  nodes,  type  of  topology,  and  the  number  of  topologies  to  the  desired  scenario. 

The  hybrid  time  synchronization  code  is  run  by  changing  the  topology  type,  the  number 

of  nodes,  and  the  number  of  topologies  to  the  desired  scenario. 

%  Broadcast  sequencing  and  hybrid  time  synchronization  file 
%  un-comment  and/or  remove  lines  of  code  as  instructed  for  the  desired  scenario 
clc,  clear  all,  close  all 

numTopol  =  100; 

C  =  10; 
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%  #########  delete  the  following  for  only  broadeast  sequeneing  ############# 
t_avg_prec  =  zeros(l,C);  t  avg  lhop  =  zeros(l,C);  t_avg_2hop  =  zeros(l,C);  t_avg_3hop 
=  zeros(l,C);  t_avg_4hop  =  zeros(l,C);  t  avg  Shop  =  zeros(l,C);  t_avg_6hop  = 
zeros(l,C);  t  avg  Vhop  =  zeros(l,C);  t_avg_8hop  =  zeros(l,C);  t_avg_9hop  =  zeros(l,C); 
t  avg  lOhop  =  zeros(l,C);  t  avg  RSP  =  zeros(l,C); 

ctprec^O;  ctlhop=0;  ot2hop=0;  ct3hop=0;  ct4hop=0;  ot5hop=0;  ct6hop=0;  ct7hop=0; 
ct8hop=0;  ct9hop=0;  ctl0hop=0;  otRSP=0; 
%############################################################### 

%BP  =  0;  un-eomment  for  broadeast  sequeneing 

%AP  =  0;  un-comment  for  broadcast  sequencing 

for  nT  =  ImumTopol 

clear  S  alltimes  CL  column  nodescansync  nodetimes  newtime  TS  seqlDs  sync  max  row 
onecycle  values 
close  (figure(l)) 

%%  Input  values 

N  =  50;  %  number  of  nodes  in  WSN 

maxrange  =  100;  %  maximum  effective  range  of  nodes  (meters) 
topolsize  =  ‘Sparse’; 
idlength  =  2; 

range  =  sqrt((maxrangeA2)/2); 

S(l).xd  =  0;  S(l).yd  =  0;  %  first  node  centered  at  origin 

hold  on 

figure(l) 

plot(S(l).xd,  S(l).yd,  ‘g*’); 
nodelD  =  assignlD(idlength); 

S(1).ID=  {nodelD}; 

uistack(text(S(l).xd,  S(l).yd,  S(l).ID,’EdgeColor’,’k’,  ‘BackgroundColor’,  ‘w’),’top’); 
nodelDlist  =  S(1).ID; 

%%  Generate  the  WSN  field  and  show  topology 
if  (strcmp(topolsize,’ Sparse’)) 
signx(l)  =  sign(randn(l)); 
signy(l)  =  sign(randn(l)); 
for  i=2;N 

S(i).xd  =  S(i-l).xd  +  signx(i-l)*((range-range/3)  +  (range/3).  *rand(  1,1)); 

S(i).yd  =  S(i-l).yd  +  signy(i-l)*  ((range-range/3)  +  (range/3).  *rand(  1,1)); 
figure(l) 

plot(S(i).xd,  S(i).yd,  ‘ro’); 
nodelD  =  assignlD(idlength); 

S(i).ID=  {nodelD}; 

while(sum(strcmp(  S  (i) .  ID ,  nodeIDlist))==  1 ) 
nodelD  =  assignlD(idlength); 

S(i).ID=  {nodelD}; 
end 

uistack(text(S(i).xd,  S(i).yd,  S(i).ID,’EdgeColor’,’k’,  ‘BackgroundColor’,  ‘w’),’top’); 
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nodelDlist  =  [nodelDlist  S(i).ID]; 
signx(i)  =  sign(randn(l)); 
signy(i)  =  sign(randn(l)); 

while  signx(i)  ==  -signx(i-l)  &&  signy(i)==  -signy(i-l) 
signx(i)  =  sign(randn(l)); 
signy(i)  =  sign(randn(l)); 
end 
end 

elseif  (strcmp(topolsize,  ’Dense  ’ )) 
for  i=2;N 

S(i).xd  =  -range  +  (2*range).*rand(l,l); 

S(i).yd  =  -range  +  (2*range).*rand(l,l); 
figure(l) 

plot(S(i).xd,  S(i).yd,  ‘r*’); 
nodelD  =  assignlD(idlength); 

S(i).ID=  {nodelD}; 

while(sum(strcmp(  S  (i) .  ID ,  nodeIDlist))==  1 ) 
nodelD  =  assignlD(idlength); 

S(i).ID=  {nodelD}; 
end 

uistack(text(S(i).xd,  S(i).yd,  S(i).ID,’EdgeColor’,’k’,  ‘BackgroundColor’,  ‘w’),’top’); 
nodelDlist  =  [nodelDlist  S(i).ID]; 
end 
end 

xlabel(‘x-axis  (meters)’,  ‘FontSize’,  12);  ylabel(‘y-axis  (meters)’,  ‘FontSize’,  12); 
for  i=l;N 

S(i).numNeighbors  =  0; 
for  k=l:N 
if  i~=k 

dist  =  sqrt(double((S(i).xd  -  S(k).xd)^2  +  (S(i).yd  -  S(k).yd)^2)); 
if  dist  <  maxrange 

S(i).numNeighbors  =  S(i).numNeighbors  +  1; 
figure(l) 

uistack(plot(  [S(i).xd,  S(k).xd],  [S(i).yd,  S(k).yd]  ),’bottom’); 
S(i).neighbors(S(i).numNeighbors)  =  S(k).ID; 
else  eontinue 
end 

else  continue 
end 
end 
end 

%%  Initialize  values  for  all  nodes 
for  i=l:N 

S(i).receivedBeginPacket  =  0;  S(i).hopCount  =  0;  S(i).friendIDs  =  {}; 
S(i).sentToNeighbors  =  0;  S(i).parentIDs={};  S(i).childrenIDs={};  S(i).sequence={}; 
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end 

%%  assign  random  node  as  starter  node;  send  begin  packet  (flood  network) 
starterNode  =  randi(N); 

uistack(text(S(starterNode).xd,  S(starterNode).yd,  S(starterNode).ID,’EdgeColor’,’k’, 
‘BackgroundColor’,  ‘y’),’top’); 

S(starterNode).receivedBeginPacket=l; 

S  (starterNode) .  sentT  oN  eighbors=  1 ; 

S(starterNode).parentIDs  =  S(starterNode).ID; 

S(starterNode).childrenIDs  =  S(starterNode). neighbors; 
for  i=l  :S(starterNode).numNeighbors 
for  k=l;N 

if(  char(S(k).ID)  ==  char(S(starterNode).neighbors(i))  ) 

S(k).receivedBeginPacket  =  1; 

S(k).hopCount  =  S(k).hopCount  +  1; 

S(k).parentsHopCount  =  0; 

S(k).parentIDs  =  S(starterNode).ID; 

S(k).childrenIDs  =  S(k). neighbors; 
for  jj=l  :S(k).numNeighbors 
if(char(S(k).parentIDs)  ==  char(S(k).neighbors(jj))) 

S(k).childrenIDs(jj)=[]; 
else  continue 
end 
end 

else  continue 
end 
end 
end 

hold  off 
refcount  =  1 ; 
nodesNotified  =  0; 
while  (nodesNotified  ~=  N) 
for  i  =  1  :N 

if  (S(i).receivedBeginPacket  ==  1  &&  S(i).sentToNeighbors  ==  0  &&  S(i).hopCount 
==  refcount) 

S(i).sentToNeighbors  =  1; 
for  k=l  ;numel(S(i).childrenIDs) 
for  m=l;N 

if(  char(S(m).ID)  =  char(S(i).childrenIDs(k))) 
if(S(m).receivedBeginPacket==0) 

S(m).receivedBeginPacket  =  1; 
if  (isempty(S(m).parentlDs)) 

S(m).parentIDs  =  S(i).ID; 

S(m).hopCount  =  S(i).hopCount  +  1; 

S(m).parentsHopCount  =  S(i).hopCount; 

S(m).childrenIDs  =  S(m).neighbors; 
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for  jj= 1 :  S(m).numNeighbors 
if(char(S(m).parentIDs)  ==  char(S(m).neighbors(jj))) 
S(m).cbildrenIDs(jj)=[]; 
else  continue 
end 
end 

elseif  (S(i).bopCount  <  S(m).parentsHopCount) 

S(m).parentIDs  =  S(i).ID; 

S(m).bopCount  =  S(i).bopCount  +  1; 

S(m).parentsHopCount  =  S(i).bopCount; 

S(m).cbildrenIDs  =  S(m).neigbbors; 
for  jj= 1 ;  S(m).numNeigbbors 
if(cbar(S(m).parentIDs)  ==  cbar(S(m).neigbbors(jj))) 
S(m).cbildrenIDs(jj)=[]; 
else  continue 
end 
end 

else  continue 
end 

elseif  (S(i).bopCount  ==  S(m).parentsHopCount) 

S(m).parentIDs  =  [S(m).parentIDs  S(i).ID]; 

S(m).cbildrenIDs  =  S(m). neighbors; 

wbile(~isempty(intersect(S(m).cbildrenIDs,  S(m).parentlDs))) 
for  jj = 1 :  numel(  S  (m) .  childrenIDs) 
for  kk=l  ;numel(S(m).parentIDs) 
if  (cbar(S(m).cbildrenlDs(jj))  ==  cbar(S(m).parentIDs(kk))) 
break 

else  continue 
end 
end 

if(cbar(S(m).cbildrenIDs(jj))  =  cbar(S(m).parentIDs(kk))) 
S(m).cbildrenIDs(jj)=[]; 
break 
end 
end 
end 

else  continue 
end 

else  continue 
end 
end 
end 

else  continue 
end 
end 
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nodesNotified=0; 
for  iii=l:N 

nodesNotified  =  nodesNotified  +  S(iii).receivedBeginPacket; 
end 

if  (nodesNotified  ~=  N) 
refcount  =  refcount  +  1 ; 
else 
break 
end 
end 

for  i=l:N 

for  k=l  :numel(S(i).childrenIDs) 
for  m=l:N 

if  (  char(S(i).childrenIDs(k))==  char(S(m).ID)  ) 
if  (S(m).hopCount  ==  S(i).hopCount)  %if  neighbor’s  hop  count  is  same,  they  are 

peers 

S(i).friendIDs  =  [S(i).friendIDs  S(m).ID]; 
else  continue 
end 

else  continue 
end 
end 
end 
end 

for  i=l;N 

if(  ~  isempty(  S(i).friendIDs  )  ) 

while(  ~  isempty(  intersect(  S(i).childrenIDs,  S(i).friendIDs  )  )  ) 
for  jj  =  1  ;  numel(  S(i).childrenIDs  ) 
for  kk  =  1  ;  numel(  S(i).friendIDs  ) 
if(  char(  S(i).childrenIDs(jj)  )  ==  char(  S(i).friendIDs(kk)  )  ) 
break 

else  continue 
end 
end 

if(  char(S(i).childrenIDs(jj)  )  ==  char(  S(i).friendIDs(kk))  ) 

S(i).childrenIDs(jj)  =  []; 
break 
end 
end 
end 

else  continue 
end 
end 

for  i=l:N 

S(i).numMasters  =  numel(S(i).parentIDs); 
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S(i).numPeers  =  numel(S(i).friendIDs); 
end 

%%  all  nodes  notified;  begin  sequence  determination 
for  i=l:N 

rc(i)  =  S(i).hopCount; 
end 

refcountB  =  max(rc); 
for  i=l;N 

S(i).recSeqPkt  =  0; 
end 

nodesReceivedSeq  =  0; 
while  (nodesReceivedSeq  ~=  N) 
for  i  =  1  :N 

if(  S(i).recSeqPkt  ==  0  &&  S(i).hopCount  ==  refcountB  ) 

S(i).recSeqPkt  =  1; 

if(  isempty(S(i).childrenIDs)  )  %if  node  has  NO  children 
S(i). sequence  =  S(i).ID; 

elseif  (  numel(S(i).childrenIDs)  ==  1)  %if  node  has  ONE  child 
for  ii=l;N 

if(  strcmp(S(ii).ID,  S(i).childrenlDs)) 
if(  strcmp(S(ii).sequence(end),  S(ii).ID)) 

S(i). sequence  =  [S(ii). sequence  S(i).ID]; 
else 

for  ss  =  l;numel(S(ii). sequence) 
if(  strcmp(S(ii).sequence(ss),  S(ii).ID)) 
if(numel(S(ii).sequence(l;ss))>=numel(S(ii).sequence(ss;end))) 
final  =  S(ii).sequence(l;ss); 
else 

final  =  fliplr(S(ii).sequence(ss:end)); 
end 

else  continue 
end 
end 

S(i). sequence  =  [final  S(i).ID]; 
end 

else  continue 
end 
end 

elseif  (  numel(S(i).childrenIDs)  >  1  )  %if  node  has  more  than  one  child 
childnumID  =  []; 
childrenseqs  =  []; 
for  a=l:numel(S(i).childrenIDs) 
for  h=l:N 

if(  strcmp(S(i).childrenIDs(a),  S(h).ID)  ) 
childnumID  =  [childnumID  h]; 
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childrenseqs{a}  =  S(h). sequence; 
else  continue 
end 
end 
end 

highestID  =  findlongestsequence(S,childnumID,  childrenseqs); 

S(i). sequence  =  S(childnumID(highestID)). sequence; 
longerseq={}; 

for  ls=l  ;numel(S(childnumID(highestID)). sequence) 
if  strcmp(S(childnumID(highestID)).sequence(ls),  S(childnumID(highestID)).ID) 

==0 

longerseq(ls)  =  S(childnumID(highestID)).sequence(Is); 
else  break 
end 
end 

longerseq  =  [longerseq  S(childnumID(highestID)).ID]; 
childnumlD(highestlD)  =  []; 
remainingchildren=  {  } ; 
for  rk=l  ;length(childnumID) 
remainingcliildren(rk)  =  S(childnumID(rk)).ID; 
end 

while  numel(remainingchildren)  ~=  0 
[lastnodeinseq]  =  S(i).sequence(end); 
for  lg=l:N 

if(  strcmp(S(lg).ID,  lastnodeinseq)  ) 
lastnodelD  =  Ig; 
else  continue 
end 
end 

parentfriend  =  [S(lastnodeID).parentIDs  S(lastnodeID).friendIDs]; 
[remainingchildren,PF,S]  =  addparentfriend(S,  N,  remainingchildren, 
parentfriend,  i); 

[remainingchildren]  =  UpdateRemainingChildren(S,  i,  remainingchildren); 
if  numel(remainingchildren)==  0 
S(i). sequence  =  [S(i). sequence  S(i).ID]; 
break 
else 
end 

nextchildID  =  []; 
nextchildseq  =  []; 

for  aaa=l  :numel(remainingchildren) 
if(  isempty(intersect(  remainingchildren(aaa),  S(i). sequence  ))  ) 
for  ww=l;N 

if(  strcmp(remainingchildren(aaa),  S(ww).ID)  ) 
nextchildID  =  [nextchildID  ww]; 
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nextchildseq{aaa}  =  S(ww). sequence; 
else  continue 
end 
end 

else  continue 
end 
end 

if(length(nextchildID)  >1) 

nexthighestID  =  findlongestsequence(S,  nextchildID,  nextchildseq); 
else 

nexthighestID  =  1 ; 
end 

shorterseq={}; 

for  dd=l  ;numel(S(nextchildID(nexthighestID)). sequence) 
if(  strcmp(S(nextchildID(nexthighestID)).sequence(dd), 
S(nextchildID(nexthighestID)).ID)  ==  0) 

shorterseq(dd)  =  S(nextchildID(nexthighestID)).sequence(dd); 
else  break 
end 
end 

shorterseq  =  [shorterseq  S(nextchildID(nexthighestID)).ID]; 
for  tt=l  :numel(remainingchildren) 

if(  strcmp(S(nextchildID(nexthighestID)).ID,  remainingchildren(tt))  ) 
remainingchildren(tt)=[] ; 
break 
else 
end 
end 

[remainingchildren]  =  UpdateRemainingChildren(S,  i,  remainingchildren); 
if  numel(remainingchildren)==  0 
PFnext  =  0; 
else 

[lastnodeinseq]  =  S(nextchildID(nexthighestID)).sequence(end); 
for  lg=l:N 

if(  strcmp(S(lg).ID,  lastnodeinseq)  ) 
lastnodelD  =  Ig; 
else  continue 
end 
end 

parentfriend  =  [S(lastnodeID).parentIDs  S(lastnodeID).friendIDs]; 
[remainingchildren,  PFnext,  S]  =  addparentfriend(S,  N,  remainingchildren, 
parentfriend,  nextchildlD(nexthighestlD)); 
end 

if  PF  ==  0  &&  PFnext  ==  0 
S(i). sequence  =  longerseq; 
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S(nextchildID(nexthighestID)). sequence  =  shorterseq; 
elseif  PF  ==  0  &&  PFnext  ==  1 
S(i). sequence  =  longerseq; 
elseif  PF  ==  1  &&  PFnext  ==  0 
S(nextchildID(nexthighestID)). sequence  =  shorterseq; 
else 
end 

%adjusting  for  similarities 
%if  there  are  NO  similarities: 

if(isempty(intersect(S(i). sequence,  S(nextchildID(nexthighestID)). sequence))) 
S(i). sequence  =  [S(i). sequence  S(i).ID 
fliplr(S(nextchildID(nexthighestID)). sequence)]; 

[remainingchildren]  =  UpdateRemainingChildren(S,  i,  remainingchildren); 
if  numel(remainingchildren)==  0 
break 
else 

[lastnodeinseq]  =  S(i).sequence(end); 
for  lg=l:N 

if(  strcmp(S(lg).ID,  lastnodeinseq)  ) 
lastnodelD  =  Ig; 
else  continue 
end 
end 

parentfriend  =  [S(lastnodeID).parentIDs  S(lastnodeID).friendIDs]; 
[remainingchildren,PF,  S]  =  addparentfriend(S,  N,  remainingchildren, 
parentfriend,!); 
end 
break 

else  %there  are  similarities 

if(strcmp(S(i).sequence(l),  S(nextchildID(nexthighestID)).sequence(l))) 
if  (~isempty(intersect(S(i).sequence(2:end), 
S(nextchildID(nexthighestID)).sequence(2:end)))) 
nss  =  fliplr(S(i). sequence); 
temp=  {}; 

for  yu  =  1  :numel(nss) 

if  isempty(intersect(nss(yu),S(nextchildID(nexthighestID)). sequence)) 
temp(yu)  =  nss(yu); 
else  break 
end 
end 

S(i). sequence  =  [S(nextchildID(nexthighestID)). sequence,  S(i).ID,  temp]; 
break 
else 

S(i).sequence(l)  =  []; 
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S(i). sequence  =  [fliplr(S(i). sequence) 

S(nextchildID(nexthighestID)). sequence]; 

[remainingchildren]  =  UpdateRemainingChildren(S,  i,  remainingchildren); 
if  numel(remainingchildren)==  0 
S(i). sequence  =  [S(i). sequence  S(i).ID]; 
break 
else 
end 
end 

elseif  strcmp(S(i).sequence(end),  S(nextchildID(nexthighestID)).sequence(l)) 
if  ~isempty(intersect(S(i).sequence(l  :end-l), 
S(nextchildID(nexthighestID)).sequence(2:end))) 

nss  =  fliplr(S(nextchildID(nexthighestID)). sequence); 
temp=  {}; 

for  yu  =  1  ;numel(nss) 
if  isempty(intersect(nss(yu),S(i). sequence)) 
temp(yu)  =  nss(yu); 
else  break 
end 
end 

S(i). sequence  =  [S(i). sequence,  S(i).ID,  temp]; 
break 
else 

S(i).sequence(end)  =  []; 

S(i). sequence  =  [S(i). sequence  S(nextchildID(nexthighestID)). sequence]; 
[remainingchildren]  =  UpdateRemainingChildren(S,  i,  remainingchildren) 
if  numel(remainingchildren)==  0 
S(i). sequence  =  [S(i). sequence  S(i).ID]; 
break 
else 
end 
end 
else 

nss  =  fliplr(S(nextchildID(nexthighestID)). sequence); 
temp=  {}; 

for  yu  =  1  :numel(nss) 
if  isempty(intersect(nss(yu),S(i). sequence)) 
temp(yu)  =  nss(yu); 
else  break 
end 
end 

[remainingchildren]  =  UpdateRemainingChildren(S,  i,  remainingchildren); 
if  numel(remainingchildren)==0 
S(i). sequence  =  [S(i). sequence,  S(i).ID,  temp]; 
break 
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else 

nextchildID  =  []; 
nextchildseq  =  []; 

for  aaa=l  :numel(remainingchildren) 
if(  isempty(intersect(  remainingchildren(aaa),  S(i). sequence  ))  ) 
for  ww=l:N 

if(  strcmp(remainingchildren(aaa),  S(ww).ID)  ) 
nextchildID  =  [nextchildID  ww]; 
nextchildseq  {aaa}  =  S(ww).  sequence; 
else  continue 
end 
end 

else  continue 
end 
end 

if  length(nextchildlD)  >  1 

nexthighestID  =  findlongestsequence(S,  nextchildID,  nextchildseq); 
else 

nexthighestID  =  I ; 
end 

nextshorterseq=  { } ; 

for  dd=l  :numel(S(nextchildID(nexthighestID)). sequence) 
if(  strcmp(S(nextchildID(nexthighestID)).sequence(dd), 
S(nextchildID(nexthighestID)).ID)  ==  0) 

nextshorterseq(dd)  =  S(nextchildID(nexthighestID)).sequence(dd); 
else  break 
end 
end 

nextshorterseq  =  [nextshorterseq  S(nextchildID(nexthighestID)).ID]; 
longer  =  fliph(nextshorterseq); 
if  numel(temp)  >  numel(nextshorterseq) 
longer  =  temp; 
else 
end 

S(i). sequence  =  [S(i). sequence,  S(i).ID,  longer]; 
break 
end 
end 
end 
end 
else 
end 
else 

continue 

end 
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end 

nodesReceivedSeq=0; 
for  m=l:N 

nodesReceivedSeq  =  nodesReceivedSeq  +  S(iii).recSeqPkt; 
end 

if  (nodesReceivedSeq  ~=  N) 
refcountB  =  refcountB  -  1 ; 
else  break 
end 
end 

SSq  =  S(starterNode).  sequence; 

%preSeqCorrNum  =  numel(SSq);  before? ere  =  (preSeqCorrNum  /  N)  *  100;  BP  =  BP  + 
beforePerc;  %un-comment  for  broadcast  sequencing 

%%  sequence  correction 
for  sck=l:N 
nodeIDnum=[]; 
for  i=l;numel(SSq) 
for  k=l;N 

if(strcmp(SSq(i),S(k).ID)) 
nodelDnum  =  [nodelDnum  k]; 
else  continue 
end 
end 
end 

for  i=2;length(nodeIDnum) 

if(~isempty(intersect(S(nodeIDnum(i-l)).ID,  S(nodeIDnum(i)). neighbors))) 
continue 
else 
end 
end 

if(nodeIDnum(l)  ==  nodelDnum(end)  ) 
nodeIDnum(end)=[]; 
else 
end 

for  i=2:length(nodeIDnum) 
for  k=l  :S(nodeIDnum(i-l)).numNeighbors 
if(isempty(intersect(S(nodeIDnum(i-l)).neighbors(k),  SSq))  && 
~isempty(intersect(S(nodeIDnum(i-l)).neighbors(k),  S(nodeIDnum(i)). neighbors))) 
for  m=l:N 

if(strcmp(S(nodeIDnum(i-l)).ID,  SSq(m))) 
a=SSq(l;m); 
b=SSq(m+l:end); 

SSq=[a  S(nodeIDnum(i-l)).neighbors(k)  b]; 
nodeIDnum=[]; 
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for  ii=l:numel(SSq) 
for  kk=l:N 

if(strcmp(SSq(ii),S(kk).ID)) 
nodelDnum  =  [nodelDnum  kk]; 
else  eontinue 
end 
end 
end 
brea 

else  continue 
end 
end 
break 

else  continue 
end 
end 
end 

for  po=l  :S(nodeIDnum(end)).numNeighbors 
if  (isempty(intersect(S(nodeIDnum(end)).neighbors(po),  SSq))) 

SSq  =  [SSq  S(nodeIDnum(end)).neighbors(po)]; 
break 

else  continue 
end 
end 

SSq  =  fliplr(SSq); 
end 

%postSeqCorrNum  =  numel(SSq);  afterPerc  =  (postSeqCorrNum  /  N)  *100;  AP  =  AP  + 
afterPerc;  %un-comment  for  broadcast  sequencing 

%end  %un-comment  for  broadcast  sequencing 

%end  %un-comment  for  broadcast  sequencing 

%numTrials  =  numTopol  *  N;  BP  final  =  BP/numTrials;  %un-comment 
%AP_final  =  AP/numTrials;  %un-comment  for  broadcast  sequencing 

%%  start  synchronization 
for  i=l:N 

for  k=l  ;S(i).numNeighbors 
for  m=l:N 

if(strcmp(S(i).neighbors(k),S(m).ID)) 

S(i).neighIDs(k)  =  m; 
else  continue 
end 
end 
end 
end 

for  i=l;length(SSq) 
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for  k=l:N 

if(strcmp(SSq(i),S(k).ID)) 
seqlDs(i)  =  k; 
else  continue 
end 
end 
end 

qr  =  seqlDs;  qr(end)=[];  qr(  !)=[];  seqlDs  =  [seqlDs  fliplr(qr)];  onecycle  = 
length(seqlDs);  seqlDs  =  repmat(seqIDs,l,C);  nodetimes  =  zeros(N,l);  TS  =  zeros(N,l); 
%set  different  frequencies: 

r  = -.25;  q  =  .25;  F  =  r  +  (q-r).*rand(l,N);  f=l+F; 

%relative  skew  matrix  (saved  for  MSB  calc) 

RelSkew  =  ones(N,N); 
for  i  =  1  :N 
for  k  =  1  :N 

RelSkew(i,k)  =  f(k)./f(i); 
end 
end 

sk  =  RelSkew; 

%set  different  offsets: 

Node  1  Clock  =  0;  x  =  -10;  y  =  10;  RandOffset  =  x  +  (y-x).*rand(l,  N); 

StartOffset  =  Node  1  Clock  +  RandOffset; 

c  =  3e8;  xx  =  100;  yy  =  500;  t_p  =  xx  +  (yy-xx).*rand(l,N);  t_proc  =  t_p*(le-3); 
%builds  first  column  of  timestamps: 
for  i=l:N 

if  ~isempty(intersect(i,  S(seqIDs(l)).neighIDs)) 
dist  =  sqrt(double((S(seqIDs(l)).xd  -  S(i).xd)^2  +  (S(seqIDs(l)).yd  -  S(i).yd)^2)); 
t_prop  =  dist/c;  alltimes  =  t_prop; 
nodetimes(i,l)  =  sk(seqIDs(l),i)*alltimes  +  StartOffset(i); 

TS(i,l)=l; 

else 

dist  =  sqrt(double((S(seqIDs(l)).xd  -  S(seqIDs(2)).xd)^2  +  (S(seqIDs(l)).yd  - 
S(seqIDs(2)).yd)^2)); 
t_prop  =  dist/c;  alltimes  =  t_prop; 

nodetimes(i,l)  =  sk(seqIDs(l),seqIDs(2))*alltimes  +  StartOffset(i); 
if  seqlDs(l)  ==  i 
TS(i,l)  =  2; 
else 
end 
end 
end 

%builds  remaining  number  of  timestamps  except  last  column 
for  k=2:length(seqIDs(2:end)) 
for  i=l:N 

if  ~isempty(intersect(i,  S(seqIDs(k)).neighIDs)) 
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dist  =  sqrt(double((S(seqIDs(k)).xd  -  S(i).xd)^2  +  (S(seqIDs(k)).yd  -  S(i).yd)^2)); 
t_prop  =  dist/c;  alltimes  =  t_prop  +  t_proc(i); 
nodetimes(i,k)  =  sk(seqIDs(k),i)*alltimes  +  nodetimes(i,k-l); 

TS(i,k)  =  1;  %received  beacons 
else 

dist  =  sqrt(double((S(seqIDs(k)).xd  -  S(seqIDs(k+l)).xd)^2  +  (S(seqIDs(k)).yd  - 
S(seqIDs(k+l)).yd)^2)); 

t_prop  =  dist/c;  alltimes  =  t_prop  +  t_proc(i); 

nodetimes(i,k)  =  sk(seqIDs(k),seqIDs(k+l))*alltimes  +  nodetimes(i,k-l); 
if  seqlDs(k)  ==  i 
TS(i,k)  =  2;  %sender 
else 
end 
end 
end 
end 

%builds  last  column  of  timestamps: 

lastk  =  length(seqlDs);  nodetimes  =  [nodetimes  zeros(N,l)];  TS  =  [TS  zeros(N,l)]; 
for  i=l:N 

if  ~isempty(intersect(i,  S(seqIDs(end)).neighIDs)) 
dist  =  sqrt(double((S(seqIDs(end)).xd  -  S(i).xd)^2  +  (S(seqIDs(end)).yd  -  S(i).yd)^2)); 
t_prop  =  dist/c;  alltimes  =  t_prop  +  t_proc(i); 
nodetimes(i, lastk)  =  sk(seqIDs(end),i)*alltimes  +  nodetimes(i,lastk-l); 

TS(i, lastk)  =  1;  %received  beacons 
else 

dist  =  sqrt(double((S(seqIDs(end)).xd  -  S(seqIDs(l)).xd)^2  +  (S(seqIDs(end)).yd  - 
S(seqIDs(l)).yd)^2)); 

t_prop  =  dist/c;  alltimes  =  t_prop  +  t_proc(i); 

nodetimes(i, lastk)  =  sk(seqIDs(end),seqIDs(l))*alltimes  +  nodetimes(i,lastk-l); 
if  seqlDs(end)  ==  i 
TS(i, lastk)  =  2;  %sender 
else 
end 
end 
end 

avg_prec  =  [];  avg  lhop  =  [];  avg_2hop  =  [];  avg  Shop  =  [];  avg_4hop  =  [];  avg_5hop  = 
[];  avg  bhop  =  [];  avg  Vhop  =  [];  avg_8hop  =  [];  avg_9hop  =  [];  avg  lOhop  =  []; 
avgRSP  =  []; 

for  CL  =  onecycle  :  onecycle  :  length(seqlDs) 

%linds  master  reference  node: 
synctotal=[]; 
for  row=l:N 
nodescansync  =  0; 
for  column  =  1  :  CL 
if(TS(row,  column)==l) 
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for  lin=l:N 

if  TS(lin,column)==l  &&  lin==row 
continue 

elseif  TS(lin,  column)==l 
nodescansync  =  nodescansync  +  1 ; 
else  eontinue 
end 
end 

else  eontinue 
end 
end 

synetotal(row)  =  nodeseansyne; 
end 

synemax  =  max(synetotal); 

MastRefNode  =  lind(syne_max==synetotal); 
if  length(MastRefNode)>  1 
MastRefNode  =  MastRefNode(l); 
end 

for  i=l;N 

values  {i}  =  cell(N,2); 
end 

%gather  samples  from  same  beaeons: 
for  i=l:N 
for  k  =  1  :  CL 
ifTS(i,k)==  1 
for  m=l;N 

if  TS(m,k)==l  &&  m~=i 

values {i}  {m,l}  =  [values  {i}  {m,l}  nodetimes(m,k)]; 
values{i}  {m,2}  =  [values {i}  {m, 2}  nodetimes(i,k)]; 
else  eontinue 
end 
end 

else  eontinue 
end 
end 
end 

EstSkew  =  ones(N,N);  EstOffset  =  zeros(N,N); 
for  ii=l;N 
for  kk=1  :N 

u  =  values{ii}  {kk,l};  v  =  values{ii}  {kk,2}; 
if  length(u)  >  1 
K  =  length(u); 

skew  =  (sum(u)*sum(v)  -  K*(u*v’))  /  ((sum(v)).^2  -  K*sum(vC2)); 
offset  =  (1/K)  *  (  sum(u)-(skew*sum(v)) ); 

EstSkew(ii,kk)  =  skew;  EstOffset(ii,kk)  =  offset; 
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else  eontinue 
end 
end 
end 

for  i=l;N 
S(i). synced  =  0; 
end 

S(MastRefNode). synced  =  1; 

S(MastRefNode).newclock  =  nodetimes(MastRefNode,CL); 
prec  =  [];  R4Syn_lhop  =  [];  R4Syn_2hop  =  [];  R4Syn_3hop  =  [];  R4Syn_4hop  =  []; 
R4Syn_5hop  =  [];  R4Syn_6hop  =  [];  R4Syn_7hop  =  [];  R4Syn_8hop  =  [];  R4Syn_9hop  = 
[];  R4Syn_10hop  =  [];  RSP  =  []; 

%Execute  R4Syn: 
for  i=l:N 

if  MastRefNode  ==  i 
continue 

elseifEstOffset(i, MastRefNode)  ~=  0 
%executes  1-hop  R4Syn 

newtime  =  EstSkew(i, MastRefNode)  *  nodetimes(i,CL)  +  EstOffset(i, MastRefNode); 
S(i).newclock  =  newtime;  S(i). synced  =  1; 
p  =  abs(newtime  -  nodetimes(MastRefNode,CE)); 

S(i).precision  =  p;  prec  =  [prec,  p]; 

R4Syn_lhop  =  [R4Syn_lhop,  p]; 
else 

%2-Hop: 
for  k=l;N 

if  EstOffset(i,k)  ~=  0  &&  EstOffset(k, MastRefNode)  ~=  0 
%  executes  2-hop  R4Syn 

totfreq  =  EstSkew(i,k)  *  EstSkew(k, MastRefNode); 
totoffset  =  EstSkew(k, MastRefNode)  *  EstOffset(i,k)  + 

EstO  ffset(k, MastRefNode) ; 

newtime  =  totfreq  *  nodetimes(i,CE)  +  totoffset; 

S(i).newclock  =  newtime;  S(i). synced  =  1; 
p  =  abs(newtime  -  nodetimes(MastRefNode,CL)); 

S(i).precision  =  p;  prec  =  [prec,  p]; 

R4Syn_2hop  =  [R4Syn_2hop,  p]; 
break 

else  continue 
end 
end 

if  S(i).synced==l 
continue 
end 

%  Lines  of  code  for  3 -hop  through  9-hop  R4Syn  are  omitted  to  reduce  repetitive  lines 
that  can  be  extrapolated  by  the  10-hop  code  shown  below: 
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%  10-Hop: 
for  k=l:N 

if  EstOffset(i,k)  ~=  0 
for  1=1  :N 

if  EstOffset(k,l)  ~=  0 
for  g=l:N 

if  EstOffset(l,g)  ~=  0 
for  h=l:N 

if  EstOffset(g,h)  ~=  0 
for  d=l:N 

if  EstOffset(h,d)  ~=  0 
for  r=l:N 

if  EstOffset(d,r)  ~=  0 
for  t=l:N 

if  EstOffset(r,t)  ~=  0 
for  w=l:N 
if  EstOffset(t,w)~=0 
for  z=l:N 

if  EstOffset(w,z)~=0  &&  EstOffset(z,MastRefNode)  ~=  0 
%  executes  10-hop  R4Syn 
totfreq  = 

EstSkew(i,k)*EstSkew(k,l)*EstSkew(l,g)*EstSkew(g,h)*EstSkew(h,d)*EstSkew(d,r)*Est 

Skew(r,t)*EstSkew(t,w)*EstSkew(w,z)*EstSkew(z,MastRefNode); 

totoffset  = 

EstOffset(i,k)*EstSkew(k,l)*EstSkew(l,g)*EstSkew(g,h)*EstSkew(h,d)*EstSkew(d,r)*Es 

tSkew(r,t)*EstSkew(t,w)*EstSkew(w,z)*EstSkew(z,MastRefNode)... 

-t- 

EstOffset(k,l)*EstSkew(l,g)*EstSkew(g,h)*EstSkew(h,d)*EstSkew(d,r)*EstSkew(r,t)*Es 

tSkew(t,w)*EstSkew(w,z)*EstSkew(z,MastRefNode)... 

-H 

EstOffset(l,g)*EstSkew(g,h)*EstSkew(h,d)*EstSkew(d,r)*EstSkew(r,t)*EstSkew(t,w)*Es 

tSkew(w,z)*EstSkew(z,MastRefNode)... 

-r 

EstOffset(g,h)*EstSkew(h,d)*EstSkew(d,r)*EstSkew(r,t)*EstSkew(t,w)*EstSkew(w,z)*E 
stSkew(z,MastRefNode) . . . 

-r 

EstOffset(h,d)*EstSkew(d,r)*EstSkew(r,t)*EstSkew(t,w)*EstSkew(w,z)*EstSkew(z,Mast 

RefNode)... 

-H 

EstOffset(d,r)*EstSkew(r,t)*EstSkew(t,w)*EstSkew(w,z)*EstSkew(z,MastRefNode)... 

-r 

EstOffset(r,t)*EstSkew(t,w)*EstSkew(w,z)*EstSkew(z,MastRefNode)... 

-H 

EstOffset(t,w)*EstSkew(w,z)*EstSkew(z,MastRefNode)... 
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+ 

EstOffset(w,z)*EstSkew(z,MastRefNode)... 

+ 

EstOffset(z,MastRefNode); 

newtime  =  totfreq  *  nodetimes(i,CL)  +  totoffset; 

S(i).newclock  =  newtime; 

S(i). synced  =  1; 

p  =  abs(newtime  -  nodetimes(MastRefNode,CL)); 

S(i).precision  =  p; 
prec  =  [prec,  p]; 

R4Syn_10hop  =  [R4Syn_10hop,  p]; 
break 

else  continue 
end 
end 

%  ###  repeat  8  more  times### 
if  S(i).synced==l 
break 
end 

else  continue 
end 
end 

%  ###################### 

end 

%Execute  RSP: 
for  i=l;N 

if  S(i). synced  ==  0 
for  k=l  ;S(i).numNeighbors 
if  S(S(i).neighIDs(k)). synced  ==  1 
dist  =  sqrt(double((S(i).xd  -  S(S(i).neighIDs(k)).xd)^2  +  (S(i).yd  - 
S(S(i).neighIDs(k)).yd)^2)); 
t_prop  =  dist/c; 

T1  =  S(S(i).neighIDs(k)).newclock; 

T3  =  T1  +  t_proc(S(i).neighIDs(k)); 

T2  =  T1  +  t_prop*sk(i,S(i).neighIDs(k)); 

T4  =  T3  +  t_prop*sk(i,S(i).neighIDs(k)); 
reftime  =  T3  +  t_prop  +  t_proc(S(i).neighIDs(k)); 
nodeti  =  T4  +  t_proc(i); 

RSPskew  =  (T3-T1)/(T4-T2); 

RSPoffset  =  (T1*T4  -  T2*T3)  /  (T4-T2); 
newtime  =  RSPskew*nodeti  +  RSPoffset; 

S(i).newclock  =  newtime;  S(i). synced  =  1; 
p  =  abs(newtime  -  reftime); 

S(i).precision  =  p; 

prec  =  [prec,  p];  RSP  =  [RSP,  p]; 
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break 

else  continue 
end 
end 

else  continue 
end 
end 

AP  =  mean(prec);  AR4S1  =  niean(R4Syn_lhop);  %  repeat  for  hops  2  through  9 
AR4S10  =  mean(R4Syn_10hop);  ARSP  =  mean(RSP); 

avg_prec  =  [avg_prec,  AP];  avg  lhop  =  [avg  lhop,  AR4S1];  %  repeat  for  hops  2 
through  9 

avg  lOhop  =  [avg  lOhop,  AR4S10];  avg  RSP  =  [avg  RSP,  ARSP]; 
end 

if  isnan(avg_prec)  ==  zeros(l,C) 
if avg  prec  ==  zeros(l,C) 
avg_prec  =  zeros(l,C); 
else 

ctprec  =  ctprec  +  1 ; 
end 
else 

avg_prec  =  zeros(l,C); 
end 

%  ###the  following  lines  of  code  are  repeated  for  up  to  9  hops#### 
if  isnan(avg_lhop)  ==  zeros(l,C) 
if  avglhop  ==  zeros(l,C) 
avglhop  =  zeros(l,C); 
else 

ctlhop  =  ctlhop  +  1; 
end 
else 

avglhop  =  zeros(l,C); 
end 

%#################################################### 

if  isnan(avg_10hop)  ==  zeros(l,C) 
if  avglOhop  ==  zeros(l,C) 
avglOhop  =  zeros(l,C); 
else 

ctlOhop  =  ctlOhop  +  1; 
end 
else 

avglOhop  =  zeros(l,C); 
end 

if  isnan(avg_RSP)  ==  zeros(l,C) 
if  avgRSP  ==  zeros(l,C) 
avgRSP  =  zeros(l,C); 
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else 

ctRSP  =  ctRSP  +  1; 
end 
else 

avgRSP  =  zeros(l,C); 
end 

t_avg_prec  =  t_avg_prec  +  avg_prec; 

t  avg  lhop  =  t  avg  lhop  +  avg  lhop;  %repeat  for  hops  2  through  9 
tavglOhop  =  t_avg_10hop  +  avglOhop; 
t_avg_RSP  =  t_avg_RSP  +  avg_RSP; 

TotNumNeighbors  =  0; 
for  1=1  :N 

TotNumNeighbors  =  TotNumNeighbors  +  S(i).numNeighbors; 
end 

%  Plot  Average  Number  of  Neighbors  vs  Preeision 
AvgNumNeigh  =  TotNumNeighbors  /  N; 

NetAvgPrec=  mean(avg_prec); 

hold  on 

figure(2) 

semilogy(AvgNumNeigh,  NetAvgPrec, 

xlabel(‘Average  Number  of  Neighbors  per  Node’,  ‘FontSize’,12,’FontWeight’,  ‘bold’) 

ylabel(‘Preoision  (seeonds)’,  ‘FontSize’,12,’FontWeight’,  ‘bold’) 

xlim([0  N]) 

hold  off 

end 

hold  on 
figure(3) 
xaxis  =  1:1  :C; 
if  ctlOhop  ~=0 

semilogy(xaxis,t_avg_prec/ctprec, ’b ’,  xaxis,  t_avg_RSP/ctRSP, ’k’, 
xaxis,t_avg_lhop/ctlhop,’g’,  xaxis,t_avg_2hop/ct2hop,’r’,  xaxis,t_avg_3hop/ct3hop,’o’, 
xaxis,  t_avg_4hop/ct4hop,’m’,  xaxis,t_avg_5hop/ct5hop,’b:’, 
xaxis,t_avg_6hop/ct6hop,  ’ e :  ’ ,  xaxis, t_avg_7hop/ct7hop, ’ g:  ’ , 
xaxis,t_avg_8hop/ct8hop,’r;’,  xaxis,t_avg_9hop/ct9hop,’k;’, 
xaxis,t_avg_10hop/ctl0hop,’m:’,  ‘LineWidth’,  2) 
legend(‘Network  Average’,  ‘RSP  Average’,  ‘R4Syn  1-Hop  Average’,  ‘R4Syn  2-Hop 
Average’, ’R4Syn  3-Hop  Average’,  ‘R4Syn  4-Hop  Average’,  ‘R4Syn  5-Hop  Average’, 
‘R4Syn  6-Hop  Average’,  ‘R4Syn  7-Hop  Average’,  ‘R4Syn  8-Hop  Average’,  ‘R4Syn  9- 
Hop  Average’,  ‘R4Syn  10-Hop  Average’,  -1  ) 

%repeat  pattern  for  hops  2  through  9  for  plotting 
elseif  ctlhop  ~=0 

semilogy(xaxis,t_avg_prec/ctprec, ’b ’,  xaxis,  t_avg_RSP/ctRSP, ’k’, 
xaxis,t_avg_lhop/ctlhop,’r*’,  ‘LineWidth’,  2) 
legend(‘Network  Average’,  ‘RSP  Average’,  ‘R4Syn  1-Hop  Average’  ) 
end 
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xlabel(‘Number  of  Cycles’,  ‘FontSize’,12,’FontWeight’,  ‘bold’) 
ylabel(‘Precision  (seconds)’,  ‘FontSize’,12,’FontWeight’,  ‘bold’) 
hold  off 

%  Plot  Number  of  Hops  vs  Precision: 
if  ctlOhop  ~=0 
figure(4) 

semilogy(  1  ,mean(t_avg_  1  hop/ ct  1  hop),  ’b  *  ’  ,2,mean(t_avg_2hop/ ct2hop),  ’b  *  ’  ,3  ,mean(t_av 
g_3hop/ct3hop),’b*’,4,mean(t_avg_4hop/ct4hop),’b*’,5,mean(t_avg_5hop/ct5hop),’b*’,6 
,mean(t_avg_6hop/ct6hop),’b*’,7,mean(t_avg_7hop/ct7hop),’b*’,8,mean(t_avg_8hop/ct8 
hop),  ’b  *  ’  ,9,mean(t_avg_9hop/ ct9hop),  ’b  *  ’ ,  1 0,mean(t_avg_l  Ohop/ ct  1  Ohop),  ’b  *  ’ ,  ’  Line  Wi 
dth’,  2) 

xlabel(‘Number  of  Hops’,  ‘FontSize’,12,’FontWeight’,  ‘bold’) 
ylabel(‘Precision  (seconds)’,  ‘FontSize’,12,’FontWeight’,  ‘bold’) 

%repeat  pattern  for  hops  2  through  9  for  plotting 
elseif  ctlhop  ~=0 
figure(4) 

semilogy(  1  ,mean(t_avg_  1  hop/ ct  1  hop),  ’ b  *  ’ ,  ’  Line W idth ’ ,  2) 
xlabel(‘Number  of  Hops’,  ‘FontSize’,12,’FontWeight’,  ‘bold’) 
ylabel(‘Precision  (seconds)’,  ‘FontSize’,12,’FontWeight’,  ‘bold’) 
end 


C.  MATLAB  ASSIGN  ID  FUNCTION 

function  [  nodelD  ]  =  assignlD(idlength) 
symbols=  [‘A’:’Z’  ‘0’:’9’]; 
nums  =  randi(numel(symbols),[l  idlength]); 
nodelD  =  symbols  (nums); 
end 

D.  MATLAB  FIND  LONGEST  SEQUENCE  FUNCTION 

function  [  highestID  ]  =  fmdlongestsequence(S,  childnumID,  childrenseqs) 
highestID  =  1 ; 

for  b=2:length( childnumID)  %fmds  child  with  longest  sequence 
if(  numel(childrenseqs{b})  >  numel(childrenseqs {highestID})  ) 
highestID  =  b; 

elseif(  numel(childrenseqs{b})  ==  numel(childrenseqs {highestID})  ) 

%comparing  number  of  masters 

if  (  S(childnumID(b)).numMasters  <  S(childnumID(highestID)).numMasters  ) 
highestID  =  b; 

elseif  (S  (childnumID  (b))  .numMasters== S  (childnumID  (highestID)) .  numMasters) 
%comparing  number  of  peers 

if  (  S(childnumID(b)).numPeers  >  S(childnumID(highestID)).numPeers  ) 
highestID  =  b; 

elseif  (  S(childnumID(b)).numPeers  ==  S(childnumID(highestID)).numPeers  ) 
%or  random 
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highestID  =  b; 
else  continue 
end 

else  continue 
end 

else  continue 
end 
end 
end 

E.  MATLAB  ADD  PARENT/FRIEND  FUNCTION 

function  [remainingchildren,  PF,  S]  =  addparentfriend(S,  N,  remainingchildren, 
parentfriend,i) 

PF=0; 

while  ~isempty(  intersect(  remainingchildren,  parentfriend  )) 
shortnode  =  [];  shortestpeerseq  =  []; 
for  z=l  :numel(remainingchildren) 
for  u=l  ;numel(parentfriend) 
if  (strcmp(remainingchildren(z),  parentfriend(u))) 
for  qq=l:N 

if(strcmp(remainingchildren(z),  S(qq).ID)) 
shortnode  =  [shortnode  qq]; 
else  continue 
end 
end 

else  continue 
end 
end 
end 

for  zz=l  :length(shortnode) 
shortestpeerseq{zz}  =  S(shortnode(zz)). sequence; 
end 

%finding  shortest  child  sequence: 
shortestpeerlD  =  1 ; 
if  length( shortnode)  >=  2 
for  xx=2:length(shortnode) 

if(  numel(shortestpeerseq{xx})  <  numel(shortestpeerseq{ shortestpeerlD})) 
shortestpeerlD  =  xx; 

elseif  numel(shortestpeerseq  {xx }  )==numel(shortestpeerseq  { shortestpeerlD } )) 
if  (  S(shortnode(xx)).numPeers  >=  S(shortnode(shortestpeerID)).numPeers  ) 
shortestpeerlD  =  xx; 
else 

shortestpeerlD  =  shortestpeerlD; 
end 
else 
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shortestpeerlD  =  shortestpeerlD; 
end 
end 
else 

shortestpeerlD  =  1 ; 
end 

if(  isempty(interseet(S(shortnode(shortestpeerID)).ID,  S(i).sequenee))) 
S(i). sequence  =  [S(i). sequence,  S(shortnode(shortestpeerID)).ID]; 
PF=  1; 

for  tt=l  ;numel(remainingchildren) 
if(  strcmp(S(shortnode(shortestpeerID)).ID,  remainingchildren(tt))  ) 
remainingchildren(tt)=[] ; 
break 

else  continue 
end 
end 

if  numel(remainingchildren)  ==  0 
break 
else 

lastnodeinseq  =  S(i).sequence(end); 
for  lg=l;N 

if(  strcmp(S(lg).ID,  lastnodeinseq)  ==  1) 
lastnodelD  =  Ig; 
else  continue 
end 
end 

parentfriend  =  [S(lastnodeID).parentIDs  S(lastnodeID).friendIDs]; 
end 
else 

for  tt=l  ;numel(remainingchildren) 
if(  strcmp(S(shortnode(shortestpeerID)).ID,  remainingchildren(tt))  ) 
remainingchildren(tt)=[] ; 
break 

else  continue 
end 
end 

if  numel(remainingchildren)  ==  0 
break 
else 

lastnodeinseq  =  S(i).sequence(end); 
for  lg=l;N 

if(  strcmp(S(lg).ID,  lastnodeinseq)  ==  1) 
lastnodelD  =  Ig; 
else  continue 
end 
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end 

parentfriend  =  [S(lastnodeID).parentIDs  S(lastnodeID).friendIDs]; 
end 
end 
end 
end 

F.  MATLAB  UPDATE  REMAINING  CHILDREN  FUNCTION 

function  [remainingchildren]  =  UpdateRemainingChildren(S,  i,  remainingchildren) 
rks=  {}; 

for  k=l  :numel(remainingchildren) 
if  isempty(intersect(remainingchildren(k),  S(i). sequence)) 
rks  =  [rks  remainingchildren(k)]; 
else  continue 
end 
end 

remainingchildren  =  rks; 
end 
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